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Background 



Probability theory is one of the fastest growing areas of mathematics. Probabilistic arguments are used 
in an incredible range of applications from number theory to genetics, from geometry to finance. It is a 
core part of computer science and a key tool in analysis. And of course it underpins statistics. It is a 
subject that impinges on our daily lives: we come across it when we go to the doctor or buy a lottery 
ticket, but we're also using probability when we listen to the radio or use a mobile phone, or when we 
enhance digital images and when our immune system fights a cold. Whether you knew it or not, from 
the moment you were conceived, probability theory played an important role in your life. 

We all have some idea of what probability is: maybe we think of it as an approximation to long run 
frequencies in a sequence of repeated trials, or perhaps as a measure of degree of belief warranted by some 
evidence. Each of these interpretations is valuable in certain situations. For example, the probability 
that I get a head if I flip a coin is sensibly interpreted as the proportion of heads I get if I flip that 
same coin many times. But there are some situations where it simply does not make sense to think of 
repeating the experiment many times. For example, the probability that 'UK interest rates will be more 
than 6% next March' or the probability that 'I'll be involved in a car accident in the next twelve months' 
cannot be determined by repeating the experiment many times and looking for a long run frequency. 

The philosophical issue of interpretation is not one that we'll resolve in this course. What we will do is 
set up the abstract framework necessary to deal with complicated probabilistic questions. 

These notes are intended to complement the contents of the lectures. They contain more material than 
the lectures and, in particular, a few more examples. You arc nonetheless strongly encouraged to 
attend all of the lectures. An original version of the first part of these notes was written by Alison 
Ethcridge and I have also made extensive use of notes by Neil Laws and Jonathan Marchini. I am very 
grateful to them all. The responsibility for any errors or inaccuracies is mine. Please send any comments 
or corrections to goldschm@stats . ox . ac . uk. 

The synopsis and reading list from the course handbook are reproduced on the next page for your 
convenience. The suggested texts are an excellent source of further examples. 

I hope you enjoy the course! 
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Overview 



An understanding of random phenomena is becoming increasingly important in today's world within 
social and political sciences, finance, life sciences and many other fields. The aim of this introduction 
to probability is to develop the concept of chance in a mathematical framework. Random variables are 
introduced, with examples involving most of the common distributions. 

Learning Outcomes 

Students should have a knowledge and understanding of basic probability concepts, including conditional 
probability. They should know what is meant by a random variable, and have met the common distri- 
butions and their probability mass functions. They should understand the concepts of expectation and 
variance of a random variable. A key concept is that of independence which will be introduced for events 
and random variables. 



Synopsis 

Motivation, relative frequency, chance. Sample space, algebra of events, probability measure. Permu- 
tations and combinations, sampling with or without replacement. Conditional probability, partitions of 
the sample space, theorem of total probability, Bayes' Theorem. Independence. 

Discrete random variables, probability mass functions, examples: Bernoulli, binomial, Poisson, geometric. 
Expectation: mean and variance. Joint distributions of several discrete random variables. Marginal 
and conditional distributions. Independence. Conditional expectation, theorem of total probability for 
expectations. Expectations of functions of more than one discrete random variable, covariance, variance 
of a sum of dependent discrete random variables. 

Solution of first and second order linear difference equations. Random walks (finite state space only). 

Probability generating functions, use in calculating expectations. Random sample, sums of independent 
random variables, random sums. Chebyshev's inequality, Weak Law of Large Numbers. 

Continuous random variables, cumulative distribution functions, probability density functions, examples: 
uniform, exponential, gamma, normal. Expectation: mean and variance. Functions of a single continuous 
random variable. Joint probability density functions of several continuous random variables (rectangular 
regions only). Marginal distributions. Independence. Expectations of functions of jointly continuous 
random variables, covariance, variance of a sum of dependent jointly continuous random variables. 

Textbooks 

1. G. R. Grimmett and D. J. A. Welsh, Probability: An Introduction, Oxford University Press, 1986, 
Chapters 1-4, 5.1-5.4, 5.6, 6.1, 6.2, 6.3 (parts of), 7.1-7.3, 10.4. 

2. J. Pitman, Probability, Springer- Verlag, 1993. 

3. S. Ross, A First Course In Probability, Prentice-Hall, 1994. 

4. D. Stirzaker, Elementary Probability, Cambridge University Press, 1994, Chapters 1-4, 5.1-5.6, 
6.1-6.3, 7.1, 7.2, 7.4, 8.1, 8.3, 8.5 (excluding the joint generating function). 
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Chapter 1 



Events and probability 



1.1 Introduction 

We will think of performing an experiment which has a set of possible outcomes Q. We call the sample 
space and its elements sample points. For example, 

(a) tossing a coin: f2 = {H, T}; 

(b) throwing two dice: il = ■ 1 < i,j < 6}. 

A subset of is called an event. An event A C 51 occurs if, when the experiment is performed, the 
outcome w e ft satisfies to e A. You should think of events as things you can decide have or have not 
happened by looking at the outcome of your experiment. For example, 

(a) coming up heads: A = {H}; 

(b) getting a total of 4: A = {(1, 3), (2, 2), (3, 1)}. 

The complement of A is A c := ft \ A and means " A does not occur". For events A and B, 

AU B means "at least one of A and B occurs" ; 
AO B means "both A and B occur" ; 
A \ B means " A occurs but B does not" . 

If A n B = we say that A and B are disjoint - they cannot both occur. 
We assign a probability P (A) e [0, 1] to each (suitable) event. For example, 

(a) for a fair coin, ¥ (A) = 1/2; 

(b) for two unweighted dice, ¥ (A) = 1/12. 
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(b) demonstrates the importance of counting in the situation where we have a finite number of possible 
outcomes to our experiment, all equally likely. For (b), £1 has 36 elements (6 ways of choosing i and 6 
ways of choosing j). Since A = {(1, 3), (2, 2), (3, 1)} contains 3 sample points, and all sample points are 
equally likely, we get P (A) = 3/36 = 1/12. 

We want to be able to tackle much more complicated counting problems. 



1.2 Counting 

Most of you will have seen this before. If you haven't, or if you find it confusing, then you can find more 
details in the first chapter of Introduction to Probability by Ross. 



Arranging distinguishable objects 

Suppose that we have n distinguishable objects (e.g. the numbers 1,2, ... ,n). How many ways to order 
them (permutations) are there? If we have three objects a, b, c then the answer is 6: abc, acb, bac, bca, 
cab and cba. 

In general, there are n choices for the first object in our ordering. Then, whatever the first object was, 
we have n — 1 choices for the second object. Carrying on, we have n — m + 1 choices for the mth object 
and, finally, a single choice for the nth. So there are 

n(n-l)...2.1 =nl 

different orderings. 

Since n! increases extremely fast, it is sometimes useful to know Stirling's formula: 

where f(n) <~ g(n) means f(n)/g(n) -ylasn^oo. This is astonishingly accurate even for quite small 
n. For example, the error is of the order of 1% when n = 10. 



Arrangements when not all objects are distinguishable 

What happens if not all the objects are distinguishable? For example, how many different arrangements 
are there of a, a, a, b, c, dl 

If we had Oi, a 2 , a 3 , 6, c, d, there would be 6! arrangements. Each arrangement (e.g. 6, a 2 , d, a 3 , Oi, c) is 
one of 3! which differ only in the ordering of 01,02,03. So the 6! arrangements fall into groups of size 
3! which are indistinguishable when we put ai = o 2 = a 3 . We want the number of groups which is just 
6!/3!. 

We can immediately generalise this. For example, to count the arrangements of a, o, a, b, b, d, play the 
same game. We know how many arrangements there are if the 6's are distinguishable, but then all such 
arrangements fall into pairs which differ only in the ordering of 61, & 2 , and we see that the number of 
arrangements is 6!/3!2L 
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Lemma 1.1. The number of arrangements of the n objects 

ai, ... ,ai,a 2 , ... ,a 2 , ... ,a k , ... ,a k 
s v ' s v ' s v ' 

mi times m 2 times m k times 

where on appears rrii times and m\ + ■ ■ ■ + m k = n is 



m 1 !m 2 ! • • • m k l 



(1.1) 



Example 1.2. The number of arrangements of the letters of STATISTICS is gj^r. 



If there are just two types of object then, since mi + m 2 = n, the expression (1.1) is just a binomial 
coefficient, (") = — ^ tt = (")- 

' \mi/ mi!(n-mi)! \m 2 l 

Note: we will always use the notation 



Recall the binomial theorem, 



mj ml(n — m)\' 



(x + y) n = it f")*™*" 

m=0 ^ ' 



You can see where the binomial coefficient comes from because writing 

(x + y) n = (x + y)(x + y)---(x + y) 

and multiplying out, each term involves one pick from each bracket. The coefficient of x m y n ~" m is the 
number of sequences of picks that give x exactly m times and y exactly n — m times and that's the 
number of ways of choosing the m "slots" for the x's. 

The expression (1.1) is called a multinomial coefficient because it is the coefficient of a™ 1 • • • a™ fc in the 
expansion of 

(oi + -"+a fc ) n 
where mi + ■ ■ ■ = n. We sometimes write 



n 

mi m 2 ■ ■ ■ m k 



for the multinomial coefficient. 



Instead of thinking in terms of arrangements, we can think of our binomial coefficient in terms of choices. 
For example, if I have to choose a committee of size k from n people, there are (^) ways to do it. To see 
how this ties in, stand the n people in a line. For each arrangement of k l's and n — k O's I can create a 
different committee by picking the ith person for the committee if the ith term in the arrangement is a 
1. 

Many counting problems can be solved by finding a bijection (that is, a one-to-one correspondence) 
between the objects we want to enumerate and other objects that we already know how to enumerate. 

Example 1.3. How many distinct non-negative integer-valued solutions of the equation 

x\ + x 2 H + x rn = n 

are there? 
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Solution. Consider a sequence of n *'s and m — 1 |'s. There is a bijection between such sequences and 
non-negative integer-valued solutions to the equation. For example, if m = 4 and n = 3, 



Xl= 2 £2—0 2?3 — 1 £4—0 



There are (" + ™ 1 ) sequences of n *'s and m — 1 |'s and, hence, the same number of solutions to the 
equation. □ 



It is often possible to perform quite complex counting arguments by manipulating binomial coefficients. 
Conversely, sometimes one wants to prove relationships between binomial coefficients and this can most 
easily be done by a counting argument. Here is one famous example: 

Lemma 1.4 (Vandermonde's identity). For k,m,n> 0, 




where we use the convention (™) = for j > m. 



Proof. Suppose we choose a committee consisting of k people from a group of m men and n women. 
There are ( m ^™) ways of doing this which is the left-hand side of (1.2). 

Now the number of men in the committee is some j € {0, 1, . . . , k} and then it contains k — j women. 
The number of ways of choosing the j men is (™) and for each such choice there are choices for 

the women who make up the rest of the committee. So there are (™) ( fe ™ •) committees with exactly j 
men and summing over j we get that the total number of committees is given by the right-hand side 
of (1.2). □ 



"Breaking things down" is an important technique in counting - and also, as we'll see, in probability. 



1.3 The axiomatic approach 

Definition 1.5. A probability space is a triple (Q, J 7 , P) where 

1. CI is the sample space, 

2. J- is a collection of subsets of CI, called events, satisfying axioms Fi~F% below, 

3. P is a probability measure, which is a function P : T — > [0, 1] satisfying axioms P1-P4 below. 

Before formulating the axioms F1-F3 and P1-P4 we should do an example. Many of the more abstract 
books on probability start every section with "Let (fl, F, P) be a probability space" but we shouldn't 
allow ourselves to be intimidated. Here's an example to see why. 

Example 1.6. We set up a probability space to model each of the following experiments: 
1. A single roll of a fair die in which the outcome we observe is the number thrown; 
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2. A single roll of two fair dice in which the outcome we observe is the sum of the two numbers thrown 
(so in particular we may not see what the individual numbers are). 

Single die. The set of outcomes of our experiment, that is our sample space, is Sli = {1, 2, 3, 4, 5, 6}. 
The events are all possible subsets of this; denote the set of all subsets of by T\. For example, 
Ei = {6} is the event "the result is a 6" and E 2 = {2, 4, 6} is the event "the result is even" . 
We're told that the die is fair so Pi({i}) is just 1/6 and Pi(-E') = ^\E\ where \E\ is the number of distinct 
elements in the subset E. Hence, Pi(£i) = g and Pi {E 2 ) = \- 

Formally, Pi is a function on T\ which assigns a number from [0, 1] to each element of T\. 

The total on two dice. The set of outcomes that we can actually observe is fi 2 — {2, 3, 4, ... , 12}. 
We take F 2 to be the set of all subsets of Q 2 . So for example E3 = {2, 4, 6, 8, 10, 12} is the event "the 
outcome is even", E4 — {2, 3, 5, 7, 11} is the event "the outcome is prime" and so on. 
Notice now however that not all outcomes are equally likely. However, tabulating all possible numbers 
shown on the two dice we get 





1 


2 


3 


4 


5 


6 


1 


2 


3 


4 


5 


6 


7 


2 


3 


4 


5 


6 


7 


8 


3 


4 


5 


6 


7 


8 


9 


4 


5 


6 


7 


8 


9 


10 


5 


6 


7 


8 


9 


10 


11 


6 


7 


8 


9 


10 


11 


12 



and all of these outcomes are equally likely. So now we can just count to work out the probability of 

each event in T 2 . For example P 2 ({12}) = ^, P 2 ({7}) = g, ¥ 2 {E 3 ) = \ and ¥ 2 {E A ) = |§. 

The probability measure is still a [0, l]-valued function on T 2 , but this time it is a more interesting one. 

This second example raises a very important point. The sample space that we use in modelling a 
particular experiment is not unique. In fact, to calculate the probabilities P 2 , in effect we took a larger 
sample space f2' 2 = {(*> j) '■ hJ € {1j 2, • • • , 6}} that records the pair of numbers thrown. But the only 
events that we are interested in for this particular experiment are those that tell us something about the 
sum of the numbers thrown. 

In order to make sure that the theory we build is internally consistent, we need to make some assumptions 
about T and P, in the form of axioms. To state them, we use notation from set theory. 



The axioms of probability 




J 7 is a collection of subsets of Q, P : T — > R and 




Fi: 0eJ,ne T. 




F 2 : If A, B £ J 7 , then A c e T and A U B e T. 




F 3 : If A4 e T for i > 1, then U^A, e T. 




Pi: For all A e T, F(A) > 0. 




P 2 : P(O) = 1. 




P 3 : If A, B e T and A n B = then ¥(A UB) = F(A) - 


hP(B). 


P 4 : If Ai £ T for i > 1 and A, t n Aj = for i ^ j then 1 


'(ug 1 ^) = E£iP(^i)- 



Note that is the event that nothing happens and fi is the event that something happens. 

Axioms Pi and P 2 are just to ensure that the probability of any event is a number in [0, 1] and that 
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something happens with probability one. We already used P3 to calculate the probabilities of events in 
our examples. 



In our examples, f2 was finite, so the statement about countable unions can be reduced to one about 
finite ones. In fact, Q can be finite or infinite, countable or uncountable, discrete or continuous. 

If f2 is a countable set, as it usually will be for the first half of this course, then we normally take F to be 
the set of all subsets of ft (the power set of fi). (You should check that, in this case, F1-F3 are satisfied.) 
If fi is uncountable, however, the set of all subsets turns out to be too large: it ends up containing sets to 
which we cannot consistently assign probabilities. This is an issue which you will see discussed properly 
in next year's Part A Integration course; for the moment, you shouldn't worry about it, just make a 
mental note that there is something to be resolved here. 

Axiom P 4 will not really impinge on our consciousness. It is possible to arrange for Pi— P3 to hold 
without P4, but it is hard work. Reassuringly, P4 follows from P1-P3 plus an intuitively appealing 
"continuity property" : 

P4: If A\ D A 2 2 • • • is a sequence from T with C\ n A n = 0, then (P (A n )) n >i is a decreasing sequence 
which tends to as n — > 00. 

Example 1.7. Consider a countable set £1 = {u>i,u! 2 , ■ ■ ■} and an arbitrary collection (pi,p2, ■ ■ ■) of 
non-negative numbers with sum YlTLiPi = 1- Put 

F(A) = £ ^ 

i-.uiiEA 

Then ¥ satisfies P1-P4. The numbers (pi,p 2 , ■ ■ •) are called a probability distribution. 

Example 1.8. Pick a team of m players from a squad of n, all possible teams being equally likely. Set 

D. = < i 2 , . ■ . , i n ) '■ ik = or 1 and ^ i k = m > , 
I fe=i J 



where 

ik = < 

Let A = {player 1 is in the team}. Then 



1 if player k is picked, 
otherwise. 



P (A) #* eams th & t mCiU de player 1 ( ™ _\ ) m 
^possible teams ( ^ ) n ' 

We can derive some useful consequences of the axioms. 

Theorem 1.9. Suppose that (Q, J 7 , P) is a probability space and that A, B € T. Then 

1. ¥(A C ) = l-P(A); 

2. If AC B then ¥ (A) < ¥ (B) . 



Proof. 1. Since A U A c = O and A n A c = 0, by P 3 , P (O) = P (A) + ¥ (A c ). By P 2 , P (O) = 1 and so 
P (A) + ¥ (A c ) = 1, which entails the required result. 

2. Since A C B, we have B = A U (B n A c ). Since B n A c C A c , it must be disjoint from A. So by P 3 , 
F(B) =¥(A)+¥(BnA c ). Since by Pi, P(BnA c ) > 0, we thus have F (B) >¥{A). □ 



Some other useful consequences are on Problem Sheet 1. 
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1.4 Conditional probability 



We have seen how to formalise the notion of probability. So for each event, which we thought of as an 
observable outcome of an experiment, we have a probability (a likelihood, if you prefer). But of course 
our assessment of likelihoods changes as we acquire more information and our next task is to formalise 
that idea. First, to get a feel for what I mean, let's look at a simple example. 

Example 1.10. Suppose that in a single roll of a fair die we know that the outcome is an even number. 
What is the probability that it is in fact a six? 



Solution. Let B = {result is even} = {2,4,6} and C = {result is a six} = {6}. Then F(B) = \ and 
P(C) = |, but if I know that B has happened, then F(C\B) (read "the probability of C given B") is § 
because given that B happened, we know the outcome was one of {2,4,6} and since the die is fair, in 
the absence of any other information, we assume each of these is equally likely. 

Now let A — {result is divisible by 3} = {3,6}. If we know that B happened, then the only way that 
A can also happen is if the outcome is in A n B, in this case if the outcome is {6} and so P(A|£?) = | 
again which is P(A n B)/V(B). □ 

Definition 1.11. Let (Q, J 7 , P) be a probability space. If A, B e T and ¥(B) > then the conditional 
probability of A given B is 

y 1 ' ¥{B) 

We should check that this new notion fits with our idea of probability. The next theorem says that it 
does. 

Theorem 1.12. Let (ft, J 7 , P) be a probability space and let B e T satisfy ¥(B) > 0. Define a new 
function Q : T -> R by Q(A) = ¥(A\B). Then (0,7",Q) is also a probability space. 

Proof. Because we're using the same J 7 , we need only check axioms P1-P4. 
Pi. For any A e 

^, „ P(A n B) 

0(A) = v , ' > 0. 



P2. By definition, 

P(nnfi) _ P(B) _ 

W j ~ V(B) ~~ V(B) ~ 
P3 and P4 have the same proof, so we just do P4: For disjoint events A\, A2, . . ., 

P((u^ 1 A i ) n B) 



V(B) 

pfu^^nB)) 

¥(B) 

EZiHAnB) 



(because Ai fl B, i > 1, are disjoint) 



¥(B) 

OO 



i=i 
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From the definition of conditional probability, we get a very useful multiplication rule: 

P(AflB) = ¥{A\B)¥(B). (1.3) 

This generalises to 

p (Ai n A 2 n A 3 n . . . n A n ) = p (Ai) p (4 2 |4i) p (A 3 |Ai n A 2 ) . . .p (A^ n A 2 n . . . n A n ^) (1.4) 

(you can prove this by induction). 

Example 1.13. An urn contains 8 red balls and 4 white balls. We draw 3 balls at random without 
replacement. Let Hi = {the ith ball is red} for 1 < i < 3. Then 

p (J?i n R 2 n J2s) = p p (^ 2 |i?i) P (R s \Ri n ifc) = ^ • ^ • 4 = ^. 

12 11 ID 55 

Example 1.14. A contains 26 tickets, one with each letter of the alphabet. If six tickets are drawn 
at random from the bag (without replacement), what is the chance that they can be rearranged to spell 
CALVIN ? 

Solution. Write for the event that the zth ticket drawn is from the set {C, A, L, V, I, N}. By (1.4), 

65432 1 

P(A 1 n...nA 6 ) = -- □ 

Example 1.15. A bitstream when transmitted has 

4 3 
P(0 sent) = -, P(l sent) = -. 

Owing to noise, 

P(l received \ sent) = -, 
8 

P(0 received \ 1 sent) = \. 
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What is P(0 sent \ received) ? 

Solution. Using the definition of conditional probability, 

™,„ i „ . P(0 sent and received) 

P(0 sent received) = — — '-. 

y 1 ' P(0 received) 

Now 

P(0 received) = P(0 sent and received) + P(l sent and received). 
Now we use (1.3) to get 

P(0 sent and received) = P(0 received | sent)P(0 sent) 

= (1 - P(l received | sent))P(0 sent) 
_ |1 _l\4 1 



Similarly, 



7 2 



P(l sent and received) = P(0 received | 1 sent)P(l sent) 

13 1 
~ 6 ' 7 ~ 14' 



10 



Putting these together gives 

118 

P(0 received) = — I = — 

2 14 14 

and 

I 7 

P(0 sent | received) = -§- = -. □ 
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1.5 Independence 

Of course, knowing that B has happened doesn't always influence the chances of A. 
Definition 1.16. 1. Events A and B are independent iff(A n B) = V(A)V(B). 

2. More generally, a family of events A = {Ai : i e /} is independent if 

P[f)AA=l[P(A t ) 

Vie. 7 / it. J 

for all finite subsets J of I. 

3. A family A of events is pairwise independent ifF(Ai n A,) = P(Ai)P(Aj) whenever i ^ j. 

WARNING: PAIRWISE INDEPENDENT DOES NOT IMPLY INDEPENDENT. 



See Problem Sheet 2 for an example of this. Also, note the spelling of independent! If you use indepen- 
dence in solving a problem then say so. 

Suppose that A and B are independent. Then if P (B) > 0, we have P (A\B) = P (A), and if P (A) > 0, 
we have P(_B|A) = ¥(B). In other words, knowledge of the occurrence of B does not influence the 
probability of A, and vice versa. 

Example 1.17. Suppose we have two fair dice. Let 

A = {first die shows 4}, B = {total score is 6} and C = {total score is 7}. 

Then 

P(inB)=P({(4,2)}) = i 

but 

F(A)¥(B) = - ■ — 4 — . 
y ' v ' 6 36 r 36 

So A and B are not independent. However, A and C are independent (you should check this). 
Theorem 1.18. Suppose that A and B are independent. Then 

(a) A and B c are independent; 

(b) A c and B c are independent. 

Proof, (a) We have A = (A n B) U {A n B c ), where An B and AC\ B c arc disjoint, so using the 
independence of A and B, 

V(An B c ) = P (A) -P(inB)=P (A) - P (A) P (B) = P (A) (1 - P (B)) = P (A) P {B c ) . 

(b) Apply part (a) to the events B c and A. □ 
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1.6 The law of total probability and Bayes' theorem 



Definition 1.19. A family of events {Bi,B 2 , ■ ■ ■} is a partition of ft if 

1. ft — U i>x Bi (so that at least one Bi must happen), and 

2. Bi n Bj — whenever i ^ j (so that no two can happen together). 

Theorem 1.20 (The law of total probability). Suppose {Bi,B 2 , ■ ■ .} is a partition o/ft by sets from, J 7 , 
such that P (Bi) > for all i > 1. Then for any A G T , 

F(A)=J2nA\B i )F(B i ). 

»>i 

This result is sometimes also called the partition theorem. We used it in our bitstream example to 
calculate the probability that was received. 



Proof. We have 



' (A) = P (A n (Ui>iSi)) , since U l > 1 B l = ft 
= P(U,> 1 (AnB ! )) 

= ^P(inBi), since A n B u i > 1 are disjoint 



»>i 



Y,W(A\Bi)F(Bi). □ 



»>i 

Example 1.21. Crossword setter I composes m clues; setter II composes n clues. Alice's probability of 
solving a clue is a if the clue was composed by setter I and j3 if the clue was composed by setter II. 

Alice chooses a clue at random. What is the probability she solves it? 
Solution. Let 

A = {Alice solves the clue} 
Bi = {clue composed by setter I}, 
B 2 = {clue composed by setter II}. 

Then 

771 Ti 

P(B!) = -^-, F(B 2 ) = —- , F(A\B 1 ) = a, P(A\B 2 ) = f3. 
m + n m + n 

By the law of total probability, 

P (A) = P (A\Bi) P (Si) + P (A\B 2 ) P (B 2 ) = + = am + P n . D 

m + n m + n m + n 

In our solution to Example 1.15, we combined the law of total probability with the definition of conditional 
probability. In general, this technique has a name: 

Theorem 1.22 (Bayes' Theorem). Suppose that {B\, B 2 , . . .} is a partition of il by sets from T such 
that P (Bi) > for alli>\. Then for any A e T such that P (A) > 0, 



P(B k \A)- nA\B k )P(B k ) 



^mmnBi)' 
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Proof. We have 

¥(B k nA) 

ns k \A)- nA) 

= F(A\B k )F(B k ) 
¥(A) 

Now substitute for P(A) using the law of total probability. □ 



See Problem Sheet 2 for a typical application of Bayes' theorem. 

In Example 1.15, we calculated P(0 sent | received) by taking {Bi,B 2 , ■ ■ ■} to be B\ = {0 sent} and 
B 2 = {1 sent} and A to be the event {0 received}. 

Example 1.23. Recall Alice, from Example 1.21. Suppose that she chooses a clue at random and solves 
it. What is the probability that the clue was composed by setter I? 



Solution. Using Bayes' theorem, 

P(B \A) = n^BijPQBi) 
1 11 ' P(A| J B 1 )P(B 1 )+P(A| J B 2 )P(B 2 ) 



m+n 



am _j_ /3n 
m+n m+n 

am 
am + (3n 



1.7 Some useful rules for calculating probabilities 

If you're faced with a probability calculation you don't know how to do, here are some things to try. 

• AND: Try using the multiplication rule: 

P(Afl5)=P (A\B) P (B) = P (B\A) P (A) 

or its generalisation: 

v{A 1 r\A 2 r\...r\A n ) = v p (A 2 \A 1 ) . . . p (A„|^i ni 2 n...n A n _i) 

(as long as all of the conditional probabilities are defined) . 

• OR: If the events are disjoint, use 

P(AiUA 2 U...Ui4 T ,)=P(Ai)+P(A 2 ) + "-+P(i4 n ). 

Otherwise, try taking complements: 

P (A 1 U A 2 U . . . U A n ) = 1 - P ((Ai U4 2 U...U A n ) c ) = 1 - P {A\ n A% n . . . n A c n ) 

("the probability at least one of the events occurs is 1 minus the probability that none of them 
occur"). If that's no use, try using the inclusion-exclusion formula (see Problem Sheet 1): 

n 

¥(A 1 uA 2 u...uA n ) = Y / P (A) -^P(A,nA 3 ) + -- + (-i)" +1 p (A 1 nA 2 n...nA,). 

i—1 i<j 
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If you can't calculate the probability of your event directly, try splitting it up according to 
partition of and using the law of total probability. 



ALWAYS CHECK THAT THE PROBABILITY THAT YOU CALCULATE IS IN 
THE INTERVAL [0, 1] ! 
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Chapter 2 



Discrete random variables 



Interesting information about the outcome of an experiment can often be encoded as a number. For 
example, suppose that I am modelling the arrival of telephone calls at an exchange. Modelling this 
directly could be very complicated: my sample space should include all of the possible starting and 
finishing times of calls, all possible numbers of calls and so on. But if I am just interested in the number 
of calls that arrive in some time interval [0, t], then I can take my sample space to be just f2 = {0, 1,2,.. .}. 
We'll return to this example later. 

Even if we are not counting something, we may be able to encode the result of an experiment as a 
number. As a trivial example, the result of a flip of a coin can be coded by letting 1 denote "head" and 
denote "tail", say. 

Real-valued discrete random variables are essentially real-valued measurements of this kind. Here's a 
formal definition. 

Definition 2.1. A discrete random variable X on a probability space (f2, J 7 , P) is a function X : 0, — > R 
such that 

(a) {u G fi : X(uj) =x}e J for each 

(b) ImX := {X(uj) : uj e 0} is a finite or countable subset ofR. 
We often abbreviate "random variable" to "r.v.". 

This looks very abstract, so give yourself a moment to try to understand what it means. 

• (a) says that {w e £1 : X(lo) = x} is an event to which we can assign a probability. We will usually 
abbreviate this event to {X = x} and write ¥ (X — x) to mean P({w € O : X(u>) = x}). If these 
abbreviations confuse you at first, put in the w's to make it clearer what is meant. 

• (b) says that X can only take countably many values. Often ImX will be some subset of N. 

• If is countable, (b) holds automatically because we can think of ImX as being indexed by 0, 
and so, therefore, ImX must itself be countable. If we also take F to be the set of all subsets of fl 
then (a) is also immediate. 
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• Later in the course, we will deal with continuous random variables, which take uncountably many 
values; we have to be a a bit more careful about what the correct analogue of (a) is; we will end 
up requiring that sets of the form {X < x} are events to which we can assign probabilities. 

Example 2.2. Roll two dice and take = {(i,j) : 1 < i, j < 6}. Take 

X(i,j) = max{z, j}, the maximum of the two scores 
Y{i,j) = i + j, the total score. 

A given probability space has lots of random variables associated with it. So, for example, in our 
telephone exchange we might have taken the "time in minutes until the arrival of the third call" in place 
of the number of calls by time t, say. 

Definition 2.3. The probability mass function (p.m.f.) of X is the function px ■ K — >• [0, 1] defined by 

p x {x) =F(X = x). 

If x i ImX (that is, X(w) never equals x) then p x (x) = P {{uj : X(w) = x}) = P (0) = 0. Also 
£ Px (x)= J2 P({w:*M=s}) 

= P j [J {uj : X(w) = x} J since the events are disjoint 

= P (SI) since every u) e ft gets mapped somewhere in ImX 
= 1. 

Example 2.4. Fix an event A^T and let X : Q — > R be the function given by 

10 otherwise. 

Then X is a random variable with probability mass function 

p x (0) =P(A = 0) =V(A C ) = 1 -¥(A), p x {l) =P(A = 1) = F(A) 

and p x (x) = for all x ^ 0,1. We will usually write X — 1a and call this the indicator function of the 
event A. 

Notice that given a probability mass function px, we can always write down a probability space and a 
random variable defined on it with that probability mass function. For simplicity, suppose that ImX = 
{0, 1, . . .}. Then let = {0, 1, . . .}, let T be the power set of f2, set 

P ({w}) = px{u) for each oj e f2 

and then take X to be the identity function i.e. X(co) = uj. However, this is often not the most natural 
probability space to take. For example, suppose that X represents the number of heads obtained in 
a sequence of three fair coin tosses. Then we could proceed as just outlined. But we could also take 
O = k) : i,j, k € {0,1}}, with a representing a tail and a 1 representing a head, so that an 

element of £1 tells us exactly what the three coin tosses were. Then take T to be the power set of ft, 

P({(z,j,fc)}) = 2- 3 foralH,. ? ,fce {0,1}, 

so that every sequence of coin tosses is equally likely, and finally set X((i,j,k)) = i + j + k. In both 
cases, X has the same distribution, but the probability spaces are quite different. 

Although in our examples so far, the sample space has been explicitly present, we can and will talk about 
random variables X without mentioning f2. 
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2.1 Some classical distributions 



Before introducing concepts related to discrete random variables, we introduce a stock of examples to 
try these concepts out on. All are classical and ubiquitous in probabilistic modelling. They also have 
beautiful mathematical structure, some of which we'll uncover over the course of the term. 



1. The Bernoulli distribution. X has the Bernoulli distribution with parameter p (where < p < 
1) if 

f(X = 0) = l-p, ¥(X = l)=p. 

We often write q = 1 — p. (Of course since (1 — p) + p = 1, we must have P (X = x) = for all 
other values of x.) We write X ~ Ber(p). 

We showed in Example 2.4 that the indicator function 1^ of an event A is an example of a Bernoulli 
random variable with parameter p = P (A), constructed on an explicit probability space. 

The Bernoulli distribution is used to model, for example, the outcome of the flip of a coin with "1" 
representing heads and "0" representing tails. It is also a basic building block for other classical 
distributions. 

2. The binomial distribution. X has a binomial distribution with parameters n and p (where n 
is a positive integer and p G [0, 1]) if 

p(x=fc) = Qp*(i- P r*. 

We write X <~ Wm(n,p). 

X models the number of heads obtained in n independent coin flips, where p is the probability of 
a head. To see this, note that the probability of any particular sequence of length n of heads and 
tails containing exactly k heads is p k (l — p) n ~ k and there are exactly (£) such sequences. 

3. The geometric distribution. X has a geometric distribution with parameter p 

¥(X = k) = p(l - p) k -\ fc = l,2,.... 

Notice that now X takes values in a countably infinite set - the whole of the positive integers. We 
write X ~ Geom(p). 

We can use X to model the number of independent trials needed until we see the first success, 
where p is the probability of success on a single trial. 

WARNING: there is an alternative and also common definition for the geometric distribution as 
the distribution of the number of failures, Y, before the first success. This corresponds to X — 1 
and so 

P(Y = k) =p(l -p) k , A: = 0,1,.... 
If in doubt, state which one you are using. 

4. The Poisson distribution. X has the Poisson distribution with parameter A > if 

A fe e~ A 

F(X = k) = — j - r , fc = 0,l,.... 

We write X ~ Po(A). 

This distribution arises in many applications. For example, the number of calls to arrive at a 
telephone exchange in a given time period or the number of electrons emitted by a radioactive 
source in a given time and so on. It can be extended, as we'll see, to something that evolves with 
time. The other setting in which we encounter it is as an approximation to a binomial distribution 
with a large number of trials but a low success probability for each one (see Problem Sheet 2). 
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Exercise 2.5. Check that each of these really does define a probability mass function. That is: 



• px{x) > for all x, 

• HxVx{x) = 1. 

Given any function px which is non-zero for only a finite or countably infinite number of values x and 
satisfying these two conditions we can define the corresponding discrete random variable - we have not 
produced an exhaustive list! 



2.2 Expectation 

By plotting the probability mass funtion for the different random variables, we get some idea of how each 
one will behave, but often such information can be difficult to parse and we'd like what a statistician 
would call "summary statistics" to give us a feel for how they behave. 

The first summary statistic tells us the "average outcome" of our experiment. 
Definition 2.6. The expectation (or expected value or mean,) of X is 

ELY] = xV ( x = x ) ( 2A ) 

xelvaX 

provided that X^xeimJf MP(-Y = x ) < oo. IfJ2 x eimX \ X \^(X = x ) diverges, we say that the expectation 
does not exist. 

The reason we insist that X^eimJf MP(-Y = x) is finite, that is that the sum on the right-hand side of 
equation (2.1) is absolutely convergent, is that we need the expectation to take the same value regardless 
of the order in which we sum the terms. 

Exercise 2.7. Write down the probability mass function of a random variable whose expectation does 
not exist. 

The expectation of X is the 'average' value which X takes - if we repeat the experiment that X describes 
many times and take the average of the outcomes then we should expect that average to be close to ELY]. 

Example 2.8. 1. Suppose that X is the number obtained when we roll a fair die. Then 

ELY] = 1 • V(X = 1) + 2 • ¥(X = 2) + . . . + 6 • V(X = 6) 

= l.i + 2-i + ... + 6-^=3.5. 
6 6 6 

Of course, you '11 never throw 3.5 on a single roll of a die, but if you throw a lot of times you expect 
the average number thrown to be close to 3. 5. We '11 come back to this idea. 

2. Suppose T is an event and 1a is its indicator function. Then 

E [1 A ] = • P (A c ) + 1 • P (A) = P (A) . 

3. Suppose that P (X = n) = £ ^ , n > 1. Then 

71=1 

and so the expectation does not exist. 



oo 



tt* * — ' n 

n=l 
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4. Let X ~ Po(A). Then 

fe=0 

^(fc-l)l 

= Ae" V 
= A. 

Exercise 2.9. (On Problem Sheet 3.) Calculate the mean of the binomial and geometric distributions. 

The definition of expectation is more general than you might initially think. Let / : 1 4 1. Then if X 
is a discrete random variable, Y = f(X) is also a discrete random variable. 

Theorem 2.10. then 

E [/(*)]= ]T f(x)V(X = x) 

xelmX 

provided that J2 x eimX {X = x) < 00. 

Proof. Let A = {y : y = f(x) for some x G ImA}. Then, starting from the right-hand side, 

E f{x)V{X = x) = Y, E f(x)¥(X = x) 

x£lmX y£Ax£lmX:f(x)=y 

= E E yv{x = x) 

yeA xelmX:f(x)=y 

= Ey E v(x = x) 

yeA x£lmX:f(x)=y 

= J2yV(.f(x) = y) 

yeA 

= E [f(X)} . □ 
Example 2.11. Take f(x) = x k . Then E[X k ] is called the fcth moment of X, when it exists. 

Let us now prove some properties of the expectation which will be useful to us later on. 
Theorem 2.12. Let X be a discrete random variable such that E [X] exists. 

(a) If X is non-negative then E [X] > 0. 

(b) Ifa,beR then E [aX + b] = aE [X] + b. 

Proof, (a) We have ImX C [0, 00) and so 

E [X] = xP ( X = x ) 

xelmX 
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is a sum whose terms are all non-negative and so must itself be non-negative, 
(b) Exercise. 



□ 



The problem with using the expectation as a summary statistic is that it is too blunt an instrument in 
many circumstances. For example, suppose that you are investing in the stock market. If two different 
stocks increase at about the same rate on the average, you may still not consider them to be equally good 
investments. You'd like to also know something about the size of the fluctuations about that average 
rate. 

Definition 2.13. For a discrete random variable X, the variance of X is defined by 

varpf) = E[(X -E[X}) 2 } 

provided that this quantity exists. 

(This is E [/(X)] where / is given by f(x) = (x — E [X]) 2 - remember that E [X] is just a number.) 

Note that, since (X— E [X]) 2 is a non-negative random variable, by part (a) of Theorem 2.12, var (X) > 0. 
The variance is a measure of how much the distribution of X is spread out about its mean: the more 
the distribution is spread out, the larger the variance. If X is, in fact, deterministic (i.e. P (X = a) = 1 
for some a € K) then E [X] = a also and so var (X) = 0: only randomness gives rise to variance. 

Writing fj, = E[X] and expanding the square we see that 
var (X) = E [(X — f i) 2 ] 

= ^2 (x 2 - 2[ix + fi 2 )p x (x) 

xelmX 

= x 2 px(x) + 2ii Y xp x {x)+p 2 ^2 Px{x) 

xGlmX x£lmX x£lmX 

= E [X 2 ] - 2p,E [X] + /j, 2 
= E[X 2 ] -{E[X}) 2 . 
This is often an easier expression to work with. 

Those of you who have done statistics at school will have seen the standard deviation, which is ^/var (X). 
In probability, we usually work with the variance instead because it has natural mathematical properties. 

Theorem 2.14. Suppose that X is a discrete random variable whose variance exists. Then if a and b 
are (finite ) fixed real numbers, then the variance of the discrete random variable Y = aX + b is given by 

var (Y) = var (aX + b) = a 2 var (X) . 

The proof is an exercise, but notice that of course b doesn't come into it because it simply shifts the 
whole distribution - and hence the mean - by b, whereas variance measures relative to the mean. In view 
of this, why do you think statisticians often prefer to use the standard deviation rather than variance as 
a measure of spread? 

2.3 Conditional distributions 

Back in §1.4 we talked about conditional probability W(A\B). In the same way, for a discrete random 
variable X we can define its conditional distribution. This is the obvious thing: the mass function 
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obtained by conditioning on the outcome B. 

Definition 2.15. Suppose that B is an event such that ¥ (B) > 0. Then the conditional distribution of 
X given B is 

nX = X \B)= F « X = x} " B) , 
for x e R. The conditional expectation of X given B is 

E[X\B] = ^2x¥(X = x\B), 

X 

whenever the sum converges absolutely. We write Px\b( x ) = W(X = x\B). 

Theorem 2.16 (Law of total probability for expectations). If{Bi,B 2 , ■ ■ .} is a partition ofQ such that 
F(Bi) > for alli>\ then 

E[X]=J2^[X\B l }P(B l ), 

»>1 

whenever E [X] exists. 
Proof. 

E[X] = ^2x¥(X = x) 

X 

= ^2 X (IlI V ( X = x \ B i) v ( B r)^j b y the law of total probability 
= ^^J(1 = I |B 1 )P(B 1 ) 

x i 

= £>( S (^2x¥(X = x\B i ) S j 

= J2nX\B i }¥(B i ). □ 

i 

Example 2.17. Let X be the number of rolls of a fair die required to get the first 6. (So X is geometrically 
distributed with parameter 1/6.) Find ELY] and var (X). 

Solution. Let Bi be the event that the first roll of the die gives a 6, so that B\ is the event that it does 
not. Then 

ELY] = E[Y|Bi]P(Bi) + E[X\B1]¥(B1) 
1 5 

= — | — E[l + X] (successive rolls are independent) 
6 6 

= 6 + 6 (1+Em) - 
Rearrange to get E[X] = 6 (as our intuition would have us guess). Similarly, 

E[Y 2 ] = E[X 2 |Bi]P(B!) + E[X 2 \B1]¥{B1) 
= l + + 2E[Y]+ELY 2 ]). 
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Rearranging and using the previous result (E[X] = 6) gives E[X 2 ] = 66 and so var (X) = 30. 
Compare this solution to a direct calculation using the probability mass function: 

oo oo 

E[X] = J2 k P q k -\ E[X 2 } = k 2 pq k ~\ 

fe=l k=l 

with p = g and q = | . □ 

We'll see a powerful approach to moment calculations in §5, but first we must find a way to deal with 
more than one random variable at a time. 



2.4 Joint distributions 

Suppose that we want to consider two discrete random variables, X and Y, defined on the same proba- 
bility space. In the same way as a single random variable was characterised in terms of its probability 
mass function, px{x) for i € R, so now we must specify px.y (x, y) = F(X = x,Y = y). It's not enough 
to specify P (X = x) and P (Y = y) because the events {X = x} and {Y = y} might not be independent 
(think of the case Y = X 2 , for example). 

Definition 2.18. Given two random variables X and Y their joint distribution (or joint probability 
mass function ) is 

Px,Y{x,y)=-P({X = x}n{Y = y}), x,y eR. 

We usually write the right-hand side simply as F(X = x,Y = y). We have px,y{x 1 y) > for all x, y e R 
an d J2x J2 y Px,Y(x, y) = 1. The marginal distribution of X is 

Px(x) = ^2p x ,Y(x,y) 

y 

and the marginal distribution of Y is 

Py{v) = ^2,Px,Y{x,y). 

x 

The marginal distribution of X tells you what the distribution of X is if you have no knowledge of Y. 
We can write the joint mass function as a table. 

Example 2.19. Suppose that X and Y take only the values or 1 and their joint mass function is given 
by 



X 





1 


Y 









1 

3 


1 
2 


1 


1 

12 


1 

12 



Observe that J2 X y Px,Y(x,y) = 1 (always a good check when modelling). 
The marginals are found by summing the rows and columns: 
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X 





1 




Y 















i 

3 


1 

2 


5 
6 


1 




1 


1 


1 




12 


12 


6 


Px{x) 


5 
12 


7 
12 





Notice that ¥(X = 1) = ^, F(Y = 1) = | and P(X = 1, F = 1) = ^ ^ ^ x | so {X = 1} and {y = 1} 
are not independent events. 

Whenever px (x) > for some i e I, we can also write down the conditional distribution of Y given 
that X = x: 

PY\x= x (y) =¥(Y = y\X = x) = P^py} foryeM. 

Px(x) 

The conditional expectation of Y given that X — x is then 

E[Y\x = x ] = J2ypY\x= x (y), 

V 

whenever the sum converges absolutely. 

Example 2.20. For the joint distribution in Example 2.19, we have 

4 1 
Py\x=o{Q) = g> Py|x=o(1) = q 

and 

E[Y\X = 0] = -. 

5 

Definition 2.21. Discrete random variables X and Y are independent if 

F(X = x,Y = y)= V(X = x)V(Y = y) for all x, y e R. 

In other words, X and Y are independent if and only of the events {X = x} and {Y = y} are independent 
for all choices of x and y. We can also write this as 

Px.y{x,y) = p x (x)p Y (y) for all x,y £ R. 

Example 2.22 (Part of an old Mods question). A coin when flipped shows heads with probability p 
and tails with probability q = 1 — p. It is flipped repeatedly. Assume that the outcome of different 
flips is independent. Let U be the length of the initial run and V the length of the second run. Find 
F(U = m,V = n), F(U = m), F(V = m). Are U and V independent? 



23 



Solution. We condition on the outcome of the first flip and use the law of total probability. 

F(U = m,V = n)= F(U = m,V = n\ 1st flip H)P(lst flip H) + F(U = m, V = n | 1st flip T)P(lst flip T) 
= pp m - 1 q n p + qq m - 1 p n q 
= p m+1 q n + q m+1 p n . 

CO 

F(u = m) = Y(p m+1 q n + q m+1 p n ) = p rn+1 -^— + q m+1 -P— 

{ 1 — 1 — p 

n—1 

= p m q + q m p. 

oo 2 2 

P(V = n) = J2 (p m+1 Q n + q m+1 p n ) = q n T^- +p n q 



l-p l-q 
= p 2 q n - 1 +q 2 p n ~ 1 . 

We have F(U = m,V = n) ^ f(m)g(n) unless p = q = \. So U, V are not independent unless p = \- 
To see why, suppose that p < g, then knowing that U is small, say, tells you that the first run is more 
likely to be a run of -ff's and so V is likely to be longer. Conversely, knowing that U is big will tell us 
that V is likely to be small. U and V are negatively correlated. □ 

In the same way as we defined expectation for a single discrete random variable, so in the bivariate case 
we can define expectation of any function of the random variables X and Y. Let / : R 2 — >• R. Then 



E[f(X, Y)\ = E /(*> VW(X = x,Y = y) 

x y 
x y 

provided the sum converges absolutely. 

Theorem 2.23. Suppose X and Y are discrete random variables and a, b <G M are constants. Then 

E[aX + bY] = aE[X] + bE[Y] 
provided that both E [X] and E [Y] exist. 

Proof. Setting f(x, y) = ax + by, we have 
E[f(X,Y)]=E[aX + bY] 

= ^2^2( ax + by)px.y{x, y) 

x y 

= a ^2^2 x Pxy(x,y) +b^2^2ypx,y(x,y) 

x y x y 

= a 12 x \ ^Px.y{x,y) \ + bJ2y I ^2px,y{x,v) j 

x \ y / y \ x / 

= a^2 x Px (x) + b^2 vpy (y) 

x y 

= aE[X] + bE[Y}. □ 



Note: X and Y do not have to be independent for this to hold. 
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Theorem 2.24. If X and Y are independent discrete random variables whose expectations exist, then 

E[XY] = E[X]E[Y}. 

Proof. We have 

e[xy] = J2Y1 x y p ( x = x > Y = y) 

x y 

= ^ ^ xy¥(X = x)V(Y = y) (by independence) 



\ x / \ y / 



= E[X]E[Y]. □ 
Exercise 2.25. Show that var (X + Y) = var (X) + var (Y) when X and Y are independent. 

What happens when X and Y are not independent? It's useful to define the covariance, 

cov(X,Y) =E[(X -E[X])(Y -E[Y})}. 
Notice that cov (X, X) = var (X). 

Exercise 2.26. Check that cov (X, Y)=E [XY] -E[X]E [Y] and that 

var (X + Y)= var (X) + var (Y) + 2cov (X, Y) . 

Notice that this means that if X and Y are independent, their covariance is 0. In general, the covariance 
can be either positive or negative valued. 

WARNING: cov (X, Y) = does not imply that X and Y are independent. See Problem Sheet 3 for an 
example. 

Definition 2.27. We can define multivariate distributions analogously: 

Px lt x 2 ,...,x n {xi,X2, ...,x n ) = P(Xi = Xi,X 2 =x 2 ,...,X n = x n ), 
for X\ , X2, ■ ■ ■ , x n € R, and so on. 

Finally, by analogy with the way we defined independence for a sequence of events, we can define 
independence for a family of random variables. 

Definition 2.28. A family {Xi : i G /} of random variables are independent if for all finite sets J C / 
and all collections {xi : i e J} of real numbers, 



Pf f|{X i=a;i }j =Y[¥(Xi=Xi). 

\ie.J J ieJ 
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Chapter 3 



Difference equations 



Our next topic is not probability theory, but rather a tool that you need both to answer some probability 
questions in the next chapter, as well as in all sorts of other areas of mathematics. Here is a famous 
probability problem by way of motivation. 

Example 3.1 (Gambler's ruin). A gambler repeatedly plays a game in which he wins £1 with probability 
p and loses £1 with probability 1—p (independently at each play). He must leave the casino if he loses 
all his money or if his fortune reaches £N (the house limit). 

What is the probability that he leaves with nothing if his initial fortune is £k ? 



Call the probability u k and condition on the outcome of the first play to see that 

Uk = P(ruin | initial fortune £k and win 1st game)P(win 1st game) 

+ P(ruin | initial fortune £k and lose 1st game)P(lose 1st game). 

So using independence of different plays this reads 

Uk =pu k+ i + (1 -p)ufe_i, l<k<N-l, 

and, of course, u — 1, u N = 0. 

This is an example of a second order difference equation; it is equations of this sort that we shall now 
learn how to solve. 

Definition 3.2. A fcth order linear difference equation (or recurrence relation,) has the form 

k 

Y,ajU n +j = f(n) (3.1) 

3=0 

with ao ^ and ak ^ 0, where do, . . . , otfc are constants independent of n. A solution to such a difference 
equation is a sequence (u n ) n >o satisfying (3.1) for all n > 0. 



You should keep in mind what you know about solving linear ordinary differential equations like 

d 2 y , dy „. , 
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for the function y, since what we do here will be completely analogous. 

The next theorem says that we can split the problem of finding a solution to our difference equations 
into two parts. 

Theorem 3.3. The general solution (w„)„>o (i-e. if the boundary conditions are not specified) of 

k 

a 3 U n+] = f(n) 

3=0 

can be written as u n = v n + w n where (u„) n >o is a particular solution to the equation and (w n ) n >o solves 
the homogeneous equation 

k 

O-jWn+i = 0. 

3=0 

Proof. Suppose (u n ) has the suggested form and (u n ) is another solution which may not necessarily be 
expressed in this form. Then 

k 

Y a j( u n+3 ~ Un+j) = 0. 
3=0 

So (u n ) and (u n ) differ by a solution (x n ) to the homogeneous equation. In particular, 

u„ = v n + (w n + x n ), 

which is of the suggested form since (w n + x n ) is clearly a solution to the homogeneous equation. □ 



3.1 First order linear difference equations 

We will develop the necessary methods via a series of worked examples. 
Example 3.4. Solve 

u n+ i = au n + b 
where uq — 3 and the constants a^O and b are given 

Solution. The homogeneous equation is w n+ \ = aw n . "Putting it into itself", we get 

w n — aw n -i = . . . = a n Wo = Aa n 

for some constant A. 

How about a particular solution? As in differential equations, guess a constant solution might work, so 
try v n — C. This gives C = aC + b so provided that a ^ 1 , C = and we have general solution 

u n = Aa n + 



1 - a 

Setting n = allows us to determine A: 

3 = A + - b and so A = 3 - 



1 — a 1 — a 
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Hence, 



1 — a I 1 — a 1 — a 



What happens if a = 1? An applied maths- type approach would set a = 1 + e and try to see what 
happens as e — > 0: 

^ = "o(l + e)"+ 1 _ (1 + £) 

= Mo + nb + 0(e) — > Mo + m& as e — > 0. 

An alternative approach is to mimic what you did for differential equations and "try the next most 
complex thing". We have u n+1 = u n + b and the homogeneous equation has solution w n = A (a 
constant). For a particular solution try v n — Cn (note that there is no point in adding a constant term 
because the constant solves the homogeneous equation and so it makes no contribution to the right-hand 
side when we substitute). 

Then C(n + 1) = Cn + b gives C = b and we obtain once again the general solution 

u n = A + bn. 

Setting n = yields ^4 = 3 and so u n = 3 + bn. □ 
Example 3.5. 

u n+ i = au n + bn. 

Solution. As above, the homogeneous equation has solution w n = Aa n . For a particular solution, try 
v n = Cn + D. Substituting 

C(n + 1) + D = a(Cn + D) + bn. 
Equating coefficients of n and the constant terms gives 

C = aC + b, C + D = aD, 

so again provided o/lwe can solve to obtain C = and D = . Thus for a ^ 1 

u n = Aa + - — r^r. 

1 - a (1 — a) z 

To find A, we need a boundary condition (e.g. the value of m ). □ 
Exercise 3.6. Solve the equation for a = 1 . Hint: try v n = Cn + Dn 2 . 



3.2 Second order linear difference equations 

Consider 

m„+i + au n + 6m„_i = f(n). 

The general solution will depend on two constants. For the first order case, the homogeneous equation 
had a solution of the form w n — AX n , so we try the same here. Substituting w n — AX n in 

w n+1 + aw n + 6m„_! = 
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gives 

A\ n+1 + aAX n + bAY 1 - 1 = 0. 
For a non-trivial solution we can divide by AX^ 1 and see that A must solve the quadratic equation 

A 2 + aX + b = 0. 

This is called the auxiliary equation. (So just as when you solve 2nd order ordinary differential equations 
you obtain a quadratic equation by considering solutions of the form e At , so here we obtain a quadratic 
in A by considering solutions of the form A".) 

If the auxiliary equation has distinct roots, Ai and A2 then the general solution to the homogeneous 
equation is 

w n = A 1 \ r t + A 2 \%. 

If Ai = A 2 = A try the next most complicated thing (or mimic what you do for ordinary differential 
equations) to get 

w n = (A + Bn)X n . 
Exercise 3.7. Check that this solution works. 

How about particular solutions? The same tricks as for the one-dimensional case apply. You can only 
guess, but your best guess is something of the same form as /, and if that fails try the next most 
complicated thing. You can save yourself work by not including components that you already know solve 
the homogeneous equation. 

Example 3.8. Solve 

u n+1 + 2u n - 3u„_i = 1. 
Solution. The auxiliary equation is just 

A 2 + 2A - 3 = 

which has roots Ai = —3, A 2 = 1, so 

w n = A(-3) n + B. 

For a particular solution, we'd like to try a constant, but that won't work because we know that the it 
solves the homogeneous equation (it's a special case of w n ). So try the next most complicated thing, 
which is v n = Cn. Substituting, we obtain 

C(n + 1) + 2Cn - 3C(n - 1) = 1, 

which gives C = \. The general solution is then 

u n = A(-3) n + B + ^n. 

If the boundary conditions had been specified, you could now find A and B by substitution. (Note that 
it takes one boundary condition to specify the solution to a first order difference equation and two to 
specify the solution to a 2nd order difference equation. Usually these will be the values of u and u x but 
notice that in the gambler's ruin problem we are given u and un.) □ 

One last example: 
Example 3.9. Solve 

u n+1 - 2u n + u n -\ = 1. 
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Solution. The auxiliary equation A 2 — 2A + 1 = has repeated root A = 1, so the homogeneous equation 
has general solution 

w n = An + B. 

For a particular solution, try the next most complicated thing, so v n — Cn 2 . (Once again there is no 
point in adding a Dn + E term to this as that solves the homogeneous equation, so substituting it on 
the left cannot contribute anything to the 1 that we are trying to obtain on the right of the equation.) 
Substituting, we obtain 

C(n + l) 2 - 2Cn 2 + C(n - l) 2 = 1, 
which gives C = \. So the general solution is 

u n = An + B +\i 2 . □ 

Solution to the Gambler's ruin problem (Example 3.1). We have 

Uk = puk+i + (1 - p)uk-\, \<k<N —I, 
and uo = 1, Un = 0. This is a homogeneous second-order difference equation. The auxiliary equation is 

P A 2 -A + (l-p) = 

which factorises as 



(pA-(l-p))(A-l) = 0. 
u k = A + B 



1 -v 



So A= ^=2 or 1. If \ then 



P 

for some constants A and B which we can find using the boundary conditions: 

,, \ N 

u = l = A + B and u N = = A + B 



1-p 



P 



These give 

N 



A = v " ' , r , B = 



1 



and so 

N 



u k - 

1 



Exercise: check that in the case p — \ we get 



u k = 1 - ^f, < k < N. □ 
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Chapter 4 



Random walks 



Imagine a particle which at each time point n = 0, 1, 2, . . . has a position in the set {0, 1,2, ... , TV}. For 
each position, there are rules determining where the particle can move to at the next time step from that 
position and with what probability it moves to each of the possible new positions. The important point 
is that these rules only depend on the current position, not on the earlier positions that the particle has 
visited. This is what we mean by a random walk. We will usually assume that the particle can only ever 
move to one of the neighbouring positions, in which case we say that the random walk is simple. 

Random walks can be used to model various real-world situations. For example, the path traced by a 
molecule as it moves in a liquid or a gas; the path of an animal searching for food; or the price of a 
particular stock every Monday morning. 

To be more definite, suppose that S n denotes the position of the particle at time n > 0. In general, its 
starting position, So, may be random, although it will often be fixed and deterministic. We will suppose 
that if S n e {1, 2, . . . , N — 1} for some n > 0, then 



where q = 1 — p. In other words, the walk either makes an "up" step, with probability p, or a "down" 
step, with probability q. We have to treat the cases where the walk is at one of the end-points, i.e. 
S n = or S n = N, separately. Two common rules are that the end-points and N are absorbing (the 
particle stays there forever i.e. if S n = N then S n +i = N) or reflecting (the particle moves to the unique 
neighbouring point i.e. if S n = N then S n+ i = N — 1). The simple random walk is symmetric if p = q. 

Notice that we have just defined a collection {So, S±, S2, ■ ■ •} of random variables with certain relation- 
ships between them. Note that So, Si, . . . are not independent: for example, if £5 = 4, 5*6 can only take 
the values 3 or 5, whereas if S5 = 1, Sq can only take the values or 2. Because the index now refers 
to time, we prefer to call this collection of random variables a random process and write (S n ) n >o- The 
simple random walk is the only sort of random process we will deal with in this course, but you will meet 
many more of them in Part A Probability. 

On the next page, you can see the first part of 10 simulated random walk paths on the set {0, 1,2,..., 20} 
with starting point 10, absorbing barriers at and 20 and "up probability" p — 0.4. Some paths get 
absorbed at 0, some get absorbed at 20 and some have not yet been absorbed at either. 




+ 1 with probability p 
S n — 1 with probability q, 
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Random walk simulation: p = 0.4, N = 20, start at 10 



g 

"-4— ' 

CO 

o 




time 



For a fixed value m > 0, we can write down the joint distribution of So, Si,... ,S m relatively easily. 
Suppose that the walk starts at 5 and we have absorbing barriers at and 8. Then, for example, 

P (So = 5, Si = 6, S 2 = 5) = P {So = 5) P (Si = 6\S = 5) P (S 2 = 5|5 =5,3i = 6) 

(make sure you're happy with this expression - it's just an application of the multiplication rule). We 
said that the random walk starts at 5, so P (So = 5) = 1. Now 

P(Si = 6|S = 5)=p. 

Finally, 

P(S 2 = 5|S = 5,S 1 -6)= t7 , 
because the step we make at time 2 is independent of all the previous steps we made. So we get 

P (S = 5, Si = 6, S 2 = 5) = pq. 
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In the gambler's ruin problem, the wealth of the gambler performs a simple random walk with initial 
position So = k and absorbing barriers at and N. We showed that the probability of absorption at is 




„,,. = { H?r dp ' q 0- /■•• .v. 



ifp = g = l/2, 

In terms of the random walk, the event "absorption at 0" can be written as 

{there exists n > 1 such that S n = 0} 

and 

Uk = P (there exists n > 1 such that S n = 0\So = k) . 

This raises an interesting question: must the particle be absorbed at either or TV? Or is there some 
probability of it just staying in the subset {1, 2, . . . , N — 1} forever? We can resolve this by finding 

v k := P (there exists n > 1 such that S n = N\S = k) , < k < N. 

The argument is completely analogous to that we used to find Uk- We obtain the same difference equation 
but with opposite boundary conditions, v — and v N — 1. This leads to 




v k = { '--(^ ' ' (): /,-; V. 

and we see that 

u k +v k = I 

for all < k < N. So the random walk is either absorbed at or at N, and there are no other possibilities. 

Because absorption occurs at a random time which could be arbitrarily large, it's rather difficult to 
find Uk and Vk directly from the joint distribution function of Sq, Si, . . .. The approach we used above, 
whereby we conditioned on the first step and used that to write down a difference equation, is much 
more effective. 

We will go through a series of worked examples of random walk problems to which we can apply the 
probabilistic tools we have developed. In what follows, we're often going to work with probabilities 
conditioned on the event {So = k} for a fixed value k. Suppose, more generally, that C is an event with 
P (C) > 0. Recall that the conditional probability Q : T -> [0, 1] defined by 



= V(A\C) 

is itself a probability measure. In particular, we can condition on further events: 

n(Aim _ mnB) _ F(AnB\c) _ P(AnBnC) _ PMIRnn 

So, for example, we can apply the law of total probability to Q: if B\, B2, ■ ■ ■ , B n is a partition of ft such 
that Q(Bi) > for all 1 < i < n then 

n 

Q(A) = J2<Q(A\B i MB i ). 

i=l 

Converting back to P, this says that 

n 

W(A\C) = ^P(A| J B i nC)P( J B i |C). 
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Similarly, if X is a discrete random variable, we get 

n 

E[X\C] = ^E[X|B;nC]P(B i |C). 

»=1 

Example 4.1. Suppose we start at k and we know that absorption occurs at 0. What is the probability 
that the first move was from k to k — 1 ? (Assume p ^ q.) 

Solution. We want to calculate P(Si = k— l|So = k, absorption at 0). Manipulating the conditional 
probabilities, we get 

m) . , , , . „. P (Si = k — 1, absorption at 0\Sn = k) 

P Si = k - 1 S = k, absorption at = V '— V ^ 1 

P (absorption at 0|«5o = k) 

_ P (Si = k - 1\S = k)¥ (absorption at 0|S = k, Si = k - 1) 

P (absorption at 0|So = fc) 

We already know that P (Si = k — 1\Sq = k) = q and P (absorption at 0|So = k) = Uk- What about 
P (absorption at 0|So = k, S\ = k — 1)? This is exactly like asking for the probability of absorption at 
started from k — 1 - the fact that we made a step from k to k— 1 before that doesn't affect what happens 
from k—1 on. So this probability is equal to Uk-i- So we get 



qu k - 



i _q(( q p ) k - 1 -( q p ) N ) 



P(Si = k - 1|S = k, absorption at 0) - - (g\k_(Q\N ' 

Intuitively, we would expect this to be bigger than q - knowing that the walk is absorbed at should 
make it more likely that the first step was downwards. This turns out to be true - check! (You might 
find it helpful to treat the cases p > q and q > p separately.) □ 

Example 4.2. Now suppose we randomly allocate the initial point on the integers 0, 1, . . . , N i.e. So has 
a uniform distribution on {0, 1, ... , N}. Again assume that p ^ q. What is the probability that absorption 
occurs at rather than N? 



Solution. We will apply the usual law of total probability. We take the partition to be over the starting 
point of the chain i.e. the partition is given by the events {S = 0}, {S = 1}, . . . , {S = N}. So 



1 (absorption at 0) = P (absorption at 0|S = k) P (S = k) 



k=0 



Uniform selection of the starting point gives P (So = k) = jy^j, for k = 0, 1, . . . , N. Hence, 



N 1 
' (absorption at 0) = ^ Uk ^ — ^ 



k=0 



1 (Eto(g)*)-(j V + !)(£)" 
N + l 

l-(j) N+1 -(N+l)(l-( q -W p ) N 
l-(jV + l)(|) jv + jV(|) jv + 1 

(7v + i)(i-(2))(i-(|n • 



□ 
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Example 4.3. In principle, we can deal with different move possibilities and probabilities. For example, 
suppose that given S n = k € {1, 2, . . . , N — 2} for some n > 0, the particle moves as follows: 

S n — 1 with probability q, 
S n +i = { S n + 1 with probability p, 
S n + 2 with probability r, 

where q + p + r = 1 . Suppose that we have absorbing barriers at and N and that if S n = N — 1 then 



S n — 1 wii/i probability q, 
S n + 1 wii/i probability p + r. 



What is the probability of absorption at given we start at k? 

Solution. Using our conditional version of the law of total probability, and partitioning over the different 
possible moves at the first step, we get 

P (absorption at 0|S = k) = P (absorption at 0|S = k, Si = k - 1) P (S 1 = k - l\S = fc) 

+ P (absorption at 0|S = k, Si = k + f ) P (Si = k + 1|S = k) 
+ P (absorption at 0|S = k, Si = k + 2) P (Si = k + 2|S = fc) 

for f < k < N — 2. Let u k = P (absorption at 0|S = fc). Then we have 

u k = qu k -i + pu k+ i + ru k+2 , I < k < N - 2. 

This is a third-order difference equation. Moreover, u = 1 , u N = and 

Un-i = (p + r)u N + qu N _ 2 ] 

these three equations provide the necessary boundary conditions. In principle we need to solve the cubic 

p\ 3 + r\ 2 - X + q = 

but since A = 1 is clearly a root, in practice we only need to solve a quadratic. □ 

Example 4.4. The number of steps until absorption (at either or N) is random. Assume p^q. What 
is the expected number of steps to absorption? 

Solution. We will use the conditional version of the law of total probability for expectations. Let X be 
the number of steps (from time onwards) to absorption. Then for k £ {1, 2, . . . , N — 1}, 

E [X\S = fc] = E [X\S = fc, Si = k + 1} P (Si = fc + 1|S = fc) 

+ E [X\S = k,S 1 = k-l]¥(S 1 = k- 1|S = fc) . 

Set e k = E [X\So = fc]. There are two terms here we need to think carefully about: E [X\So = fc, Si = fc + 1] 
and E [X\Sq — fc, Si = fc — 1]. Let X be the number of steps from time 1 onwards until the walk is ab- 
sorbed. Clearly, X = 1 + X, as long as So 7^ 0,N (if So = or N, the time to absorption is just 0). 
Now 

E [X\S = fc, Si = fc + 1] = E [l + X|S = fc, Si = fc + ij = 1 + E \x\S a = fc, Si = fc + 1 

Now, since we know that Si = fc + 1, the value of So doesn't have any influence on X. Moreover, starting 
at time 1 and asking for the expected time to absorption from fc + I is exactly the same problem as 
starting at time and asking for the expected time to absorption from fc + 1. So 

E \x\S = fc, Si = fc + lj = E [X\S = fc + 1] = e k+1 . 
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The same argument works to show that E [X\So = k, Si — k — 1] — 1 + e k -i- So we get 

e k = (1 + e k _i)q + (1 + e fe+ i)p 

which rearranges to give 

pe k+1 -e k + qe k -\ = -1, 
with boundary conditions e = e w = 0. 

The homogeneous equation is 

pfk+i - fk + qfk-i = o 

which gives auxiliary equation 

p\ 2 - X + q = 
with solutions A = 1 or q/p. So f k = A + B(q/p) k . 

For a particular solution, try g k = Ck (it's no good trying a constant since that's part of the comple- 
mentary solution). This yields 

P C(k + 1)-Ck + qC(k - 1) = -1 
and so C = l/(q — p). Putting everything together, we get 



e k = A + B 
Using the boundary conditions, we get 



q\ k k 



pj q-p 



e Q = Q = A + B, e N =0 = A + B[l) + 



v) q-p 



Solving for A and B, we finally obtain 



N _ N (q\ k _ k 

ek (p <z)(i - (| W) ~(p- - (| W) \p) ~p^i 

for < k < N. □ 

Example 4.5. Suppose we have a simple random walk with p ^ q, absorption at and a reflecting 
barrier at N . What is the expected time until absorption? 

Solution. Let e k be the expected number of steps to absorption (which can now only happen at 0). 
The difference equation for e k is the same: 

pe k +i ~e k + qe k -i = -1, 
for 1 < k < N — 1. We still have e = 0, but because of the reflection at TV we get 

E [X\S = N]=e\i + X\S = N, S! = N - lj P (Si = TV - 1|S - N) . 
Since P (Si = TV — f \Sq = N) = 1 , arguing as before this gives 

e N = 1 + ejv-i, 

which is the second boundary condition. Solving as before, we get 



e k = A + B 



q \ k 



pj q-p 
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and the boundary conditions give 

2p 2 




□ 



What happens if we instead have a random walk on the infinite set {0,1,2,...} with an absorbing 
barrier at 0? We can get an idea by letting TV — > oo. Let's see what happens to the probability, u k N \ of 
absorption at started from k as N — > oo. We have 

Um?r flim^m^ if^, f(*)* if P > 5 

[lim^l-A ifp = g = l/2 [l ifp< 9 . 

It turns out that this really does give the absorption probability for the random walk on the infinite set. 
So if the probability of moving left is greater or equal to the probability of moving right at each step, 
the random walk always hits 0. On the other hand, if the probability of moving right is strictly larger 
than the probability of moving left then there is a strictly positive probability (1 — (q/p) k ) that the walk 
will never hit 0, started from k. Why is this not a rigorous argument? Because we don't know that the 
absorption probability for the random walk on an infinite set can be obtained by simply sending N — > oo 
in the finite problem - we would need some sort of continuity property of the absorption probability 
in order to make this argument work. The proof given below is rather involved and is therefore non- 
examinable, but is a nice application of some of the methods we have developed in this course so far 
(including solving difference equations and enumerating combinatorial objects by finding a bijection with 
something easier to count). There are quicker proofs of this result, but they require more mathematical 
technology! 

Theorem 4.6. (Non- examinable) Suppose that (S n ) n >o a simple random walk on {0, 1,2,.. .} with up 
probability p and an absorbing barrier at 0. Let 

Uk = P {absorption at \Sq = k) , k > 0. 

Then 

(■;Y ifP>>l- 



ifp < q- 



Proof. As in the case of a random walk on {0, 1,2,..., N}, we get 

u-k =pu k+ i +qu k -\ 

which, for q, has general solution 

u k = A + B 



k 

q ' 



for some constants A and B and, for p = q = 1/2, has general solution 

u k = C + Dk 

for some constants C and D. We now have only a single boundary condition, u = 1, which tells us that 
A = 1 — B and that C = 1. So we need an argument which will allow us to determine B and D. 

Finding D is easy: Uk is a probability for all k > and so, in particular, it must lie between and 1. 
The only way to arrange for this to be true for all k is to take D = (if D < then eventually 1 + Dk 
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will be negative; if D > then eventually 1 + Dk will exceed 1). So in the symmetric case, u k = 1 for 
all k > 0. The same argument works to give -B = for p < 1/2, since (q/p) h is increasing in k. 

Finding B in the case p > q is a bit more involved. We will do it by calculating U\. First notice that 

So 



mi = P (J {SWi = and S fe > 1, 1 < k < 2n} 

\n=0 

oo 

= ^ P (5 2n+ i = and S k > 1, 1 < fc < 2n|S , = 1) . 



1 



(*) 



n=0 



since the union is of disjoint events. We'll calculate a generic term in the sum. 



Fix n > 0. Any path from So = 1 to SW+i = such that Sk > 1 for 1 < k < 2n must have S2n = 1- 
Moreover, it contains n up-steps and n+ 1 down-steps and so must have probability How many 

such paths are there? It's sufficient to count paths which go from I to I in 2n steps and which stay > 1, 
since the last step is always down to 0. It's easier to think of this as 

#{paths from 1 to 1 in 2n steps} — #{paths from 1 to I in 2n steps which go through 0}. 

There are ( 2 ™ ) paths from I to I in 2n steps, since we need n up-steps and n down-steps and there are 
( 2 ™ ) ways to choose the positions of the up-steps. 

To count paths from I to 1 in 2n steps which go through 0, we use the reflection principle. This says 
that there is a bijection between these paths and paths from I to —1 in 2n steps. The easiest way to see 
why this is true is to draw a picture: 



3 - 
2 
1 - 







The solid line is a path from 1 to I in 2n steps (with n = 6) which goes through 0. When it first hits 0, 
create a new path by doing the opposite step each time to that done by the original path. This gives a 
path from 1 to —1 in 2n steps. You can check that every path from 1 to —I in 2n steps can be obtained 
in this way (and so we really do have a bijection between the two sets of paths). 

Fortunately, paths from 1 to —1 in 2n steps are easier to enumerate! There are ( n 2 +i) of them, since we 
just need to choose the positions of the n + 1 down-steps. So we obtain 



#{paths from I to 1 in 2n steps which stay > 1} 



2n 
n + l 



I 



(This is the nth Catalan number, which comes up very frequently in all sorts of counting problems.) 
Hence, we have that 



P (5 2 „+i = and S k > 1, 1 < k < 2n\S = 1) = 



f 



n+l 



2n 



p n q n+1 



:-!8 



and so, by (*), 



Ui 



?),=() v ' n=0 v ' 



1 - VI - 4pg 
2^ ' 



where the last equality follows from a Taylor expansion. Now, 1 — 4pq = 1 — Ap + 4p 2 = (2p — l) 2 and 
so, since p > 1/2, VI — Apq = 2p — 1. Hence, «i = g/p. The desired result follows. □ 
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Chapter 5 

Probability generating functions 



We're now going to turn to an extremely powerful tool, not just in calculations but also in proving more 
abstract results about discrete random variables. 

From now on we consider non-negative integer-valued random variables i.e. X takes values in {0, 1,2,...}. 

Definition 5.1. Let X be a non-negative integer-valued random variable. The probability generating 
function (p.g.f.) of X is Gx ■ K — > R defined by 

G X ( S )=E[ S X ] 

for all sel such that the expectation exists, that is for which J2T=o l s | fc lP(^ = k) < oo. 
Let us agree to save space by setting 

p k =Px(k)=¥(X = k). 

Notice that because Yl^oPk — 1> Gx(s) is certainly defined for \s\ < 1 and GxiX) = 1- Notice also that 
Gx(s) is just a real- valued function. The parameter s is the argument of the function and has nothing 
to do with X. It plays the same role as a; if I write sin a;, for example. 1 

Why are generating functions so useful? Because they encode all of the information about the distribution 
of X in a single function. It will turn out that we can get at this information by using the tools of calculus. 

Theorem 5.2. The distribution of X is uniquely determined by its probability generating function, Gx- 

Proof. First note that Gx{0) = Po- Now, for \s\ < 1, we can differentiate Gx(s) term-by-term to get 

G'x(s) =Pi + 2f> 2 s + 3p 3 s 2 + • • • • 

1 Thc probability generating function is an example of a power series, that is a function of the form f(x) = 5Z^Lq c„x n . 
It may be that this sum is diverges for some values of x; the radius of convergence is the value r such that the sum converges 
if |x| < r and diverges if \x\ > r. For a probability generating function, we can see that the radius of convergence must be 
at least 1. For the purposes of this course, you are safe to assume that the derivative of / is well-defined for \x\ < r and is 
given by 

oo 
n=l 

i.e. what you would get differentiating term-by-term. You will learn more about power series in Analysis I & II. 
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Setting s = 0, we see that G' x (0) = p\. Similarly, by differentiating repeatedly, we see that 

^ k G x {s)\ s ^ = k\ Pk . 

So we can recover Po,Pi, - ■ ■ from Gx- □ 

Probability generating functions for common distributions. 

1. Bernoulli distribution. X ~ Ber(p). Then 

°x 0) = J! ^ = 1 S ° + P sl = 1 + P s 

k 

for all set. 

2. Binomial distribution. X <~ Bin(n,p). Then 

G x (a) = (?W -p)""* = (jw l (l-r fc = (1-P + P*) n , 

by the binomial theorem. This is valid for all set. 

3. Poisson distribution. X ~ Po(A). Then 

Gxw = E«*^ = «- A E^- = « A( - 1) 

fe=0 fc=0 

for all set. 

4. Geometric distribution with parameter p. Exercise on Problem Sheet 5: check that 

Gx(s) = - -, 

1 - (l-p)s 

provided that \s\ < j^. 
Theorem 5.3. If X and Y are independent, then 

G x+ y{s)=G x {s)G y {s). 

Proof. We have 

G x+ y(s)=E[ s x + y ] = E[s x s y ]. 

Since X and Y are independent, s x and s Y are independent (by Question 2 on Problem Sheet 4). So 
then by Theorem 2.24, this is equal to 

E[s x ]E[s Y ] =Gx(s)G Y (s). □ 
This can be very useful for proving distributional relationships. 

Theorem 5.4. Suppose that Xi,X 2 , ■ ■ ■ ,X n are independent Ber(p) random variables and let Y = 
X 1 + ---+X n . Then Y ~ Bin(ra,p). 
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Proof. We have 

G Y (s) = E[s Y ] = E[s Xl+ - +Xn ] = E[s Xl ■ ■ ■ s x ~] = E[s Xl ] • • • E[s x "} = (1 - p + ps) n . 
As Y has the same p.g.f. as a B'm(n,p) random variable, we deduce that Y <~ Bin(n,p). □ 

The interpretation of this is that Xi tells us whether the zth of a sequence of independent coin flips is 
heads or tails (where heads has probability p). Then Y counts the number of heads in n independent 
coin flips and so must be distributed as Bin(n,p). 

Theorem 5.5. Suppose that Xi,X 2 , ■ ■ ■ ,X n are independent random variables such that Xi <~ Po(Aj). 
Then 

n / n \ 

»=1 \i=l / 

In particular, if Xi = A for all 1 < i < n then Y^7=i X i ~ Po(nA). 
Proof. Recall that E [s x *] = e Xi( - s ~ 1 \ By independence, 

n n / n \ 

E = TT E [s x *] = J] e^'-V = exp ( (a - 1) ^ Ai . 

i=l i=l \ i=l / 

Since this is the p.g.f. of the Po(£3" =1 A*) distribution and probability generating functions uniquely 
determine distributions, the result follows. □ 



5.1 Calculating expectations using probability generating func- 
tions 



We've already seen that differentiating Gx(s) and setting s = gives us a way to get at the probability 
mass function of X. Derivatives at other points can also be useful. We have 



G' x {s) = = — skp ( X = k ) = £ ^ S * P ( X = k ) = J2 fcs ^ lp (X = k)= E[Xs x - 1 }. 

k=Q fe=0 k=0 

So 

G' x (l)=E[X] 
(as long as E [X] exists). Differentiating again, we get 

G x (l) = E[X(X - 1)] = E[X 2 } - E[X], 



and so, in particular, 
In general, 



var(X) = G^(l) + G^(l)-(G^(l)) 2 

d k 



ds^ 



= E[X(X -!)■■■ {X -k + I)]. 

s=l 



Example 5.6. Let Y = X\ + X 2 + X 3 , where X\, X 2 and X 3 are independent random variables each 
having probability generating function 
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1. Find the mean and variance of X\. 

2. What is the p.g.f. ofY? What is P(Y = 3) ? 

3. What is the p.g.f. of 3Xt? Why is it not the same as the p.g.f. ofY? What is P(3Xi = 3)? 

Solution. 1. Differentiating the probability generating function, 

G'(s) = ^+s, G"(s) = l, 

and so E[Xi] = G'(l) = § and 

var (X,) = G"(l) + G"(l) - (G'(l)) 2 = !+--_ = _. 

2. Just as in our derivation of the probability generating function for the binomial distribution, 

G Y (s) = E[s Xl+x * +X3 } = E[s Xl ]E[s* 2 ]E[s* 3 ] 

and so 

/I a s 2\ 3 1 

G Y (s) = ( - + - + — J = — (1 + 6s + 21s 2 + Us 3 + 63s 4 + 54s 5 + 27s 6 ) . 

P(F = 3) is the coefficient of s 3 in Gy(s), that is ±±. (As an exercise, calculate P(Y = 3) directly.) 

3. We have 

G 3Xl (s) = E[s^} = E[(s 3 )^] = G Xl (s 3 ) = \ + S j + 

This is different from Gy(s) because 3Xi and 53 have different distributions - knowing X\ does 
not tell you Y, but it does tell you 3^. Finally, F(SX 1 = 3) = V{X 1 = 1) = |. □ 

Of course, for each fixed s e M, s x is itself a discrete random variable. So we can use the law of total 
probability when calculating its expectation. 

Example 5.7. Suppose that there are n red balls, n white balls and 1 blue ball in an urn. A ball is 
selected at random and then replaced. Let X be the number of red balls selected before a blue ball is 
chosen. Find 



(a) the probability generating function of X, 

(b) E[X], 

(c) var(X). 

Solution, (a) We will use the law of total probability for expectations. Let R be the event that the first 
ball is red, W be the event that the first ball is white and B be the event that the first ball is blue. Then 

G x (s) = E [s x ] = E [s x \R] P (R) + E [s x \W] P (W) + E [s x \B] P (B) . 

Of course, the value of X is affected by the first ball which is picked. If the first ball is blue then we 
know that X = 0. If the first ball is white, we learn nothing about the value of X. If the first ball is red 
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then effectively we start over again counting numbers of red balls, but we add 1 for the red ball we have 
already seen. This yields 

G x (*) = E [s 1+X ] F(R)+E [s x ] P (W) + E [s°] P (B) 



2n + l w 2n + 1 2n + 1 

and so 

r (,) = 1 = 1/(n + 1) 

XW n + l-ns l-(l-l/(n+l))«' 

(b) Differentiating, we get 

G ^ (S) = (n + l-na)2 

and so 

E[X]=C x (l)=n. 

(c) Recall that 

var(X) = G^(l) + G^(l)-(G^(l)) 2 . 
Differentiating the p.g.f. again we get 

2n 2 

G X [S) = {n + l-nsY 

and so G x (l) = 2n 2 . Hence, 

var (X) = 2n 2 + n - n 2 = n(n + 1). 

If we were just asked for E [X] it would be easier to calculate 

E [X] = E [X\R] P (R) + E [X\W\ P (W) + E [X\B] P (B) 

N n 1 

= (1 + E [X] ) + E \X] + = n. 

1 1 U 2n + 1 1 J 2n+1 2n + 1 

In order to calculate var(X), however, we need both E [X] and E [X 2 ] and so it's easier just to find 
Gx(s) and differentiate it. □ 

Definition 5.8. Suppose that X\, X2, ■ ■ ■ are independent random variables which all have the same 
distribution. Then we say that Xi,X 2l ■ ■ ■ are independent and identically distributed (i.i.d.). 

Theorem 5.9. Let Xi,X 2l ■ ■ ■ be i.i.d. non-negative integer-valued random variables with p.g.f. Gx(s)- 
Let N be another non-negative integer-valued random variable, independent of Xi,X 2 , ■ ■ ■ and with p.g.f 
G N (s). Then the p.g.f. of^i X i 18 G N {G x (s)). 

Notice that the sum Y^h=i x i nas a random number of terms. We interpret it as if N = 0. 
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Proof. We partition according to the value of N: we have 

CO 

E [ s Xi+ - +Xn ] = E [s Xi+ - +Xn \N = n]¥(N = n) by the law of total probability 

n=0 

oo 

= E [s Xl+ "' +Xn \N = n] P (N = n) 

oo 

= ^E [s Xl+ - +x "] ¥(N = n) by the independence of N and {X U X 2 , . . .} 

n=0 

oo 

= E [ sXl ] ■ ■ ■ E t sX "] p ( N = n "> since Xi > X2 > ■ ■ ■ are inde P cndcnt 



n=0 



£(G JC (*))"P(JV = n) 



n=0 



= G N (G x (s)). □ 

Corollary 5.10. Suppose that X\,X2,..- are independent and identically distributed Ber(p) random 
variables and that N <~ Po(A) 7 independently of X\,X 2 , TTien X^ili ~ Po(Ap). 

(Notice that we saw this result in disguise via a totally different method on Problem Sheet 4.) 

Proof. We have Gx{s) = 1 — p + ps and Gn(s) = exp(A(s — 1)) and so by Theorem 5.9, 



E 



= G N (G x (s)) = exp(A(l - p + ps - 1)) = exp(Ap( s - 1)). 



Since this is the p.g.f. of Po(Ap) and p.g.f.'s uniquely determine distributions, the result follows. □ 

Example 5.11. In a short fixed time period, a photomultiplier detects 0, 1 or 2 photons with probabilities 
\ , | and g respectively. The photons detected by the photomultiplier cause it to give off a charge of 2, 3, 
4 or 5 electrons (with equal probability) independently for every one photon originally detected. What is 
the probability generating function of the number of electrons given off in the time period? What is the 
probability that exactly five electrons are given off in that period? 

Solution. Let N be the number of photons detected. Then the probability generating function of N is 

~ I s 1 1 1 2 



Let Xi be the number of electrons given off by the ith photon detected. Then Y = X\ + • • • + Xn is the 



total number given off in the period (remember that N here is random). Now Gx{s) = \(s 2 + s 3 + s 4 + s 5 ) 
and so, by Theorem 5.9, 



G Y (s) = G N (G x (s)) 

= l + lGx( S ) + l(G x (s)r 

The probability that five electrons are given off is the coefficient of s 5 , that is jg. □ 
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Example 5.12 (Branching process). Suppose we have a population (say of bacteria). Each individual 
in the population gives birth to a random number of children in the next generation. This number of 
children has probability mass function p(i),i > 0. Each child then reproduces independently in the same 
manner as the parent. Here is a possible family tree of such a population: 




We start at the bottom of the tree, with a single individual in generation 0. Then there are 3 individuals in 
generations 1 and 2, 5 individuals in generation 3, a single individual in generation 4 o,nd no individuals 
in subsequent generations. (Notice that in this case we must have p(0) > 0!) 

Suppose that G is the probability generating function associated with p(i),i > and that \i is its mean. 
What is the probability generating function, G n , of the population size in generation n? What is the 
expected population size in generation n ? 



Solution. Let X n be the size of the population in generation n. Then X = 1 and Xi has p.m.f. 
p(i),i > 0, so that C?i(s) = E [sf-] = G(s). Each individual i in generation n has a number d of 
children, for 1 < i < X n . So we have 

x n 

X n +\ = Ci, 

i=l 

where C\,C2, ■ ■ ■ are independent and identically distributed with p.g.f. G. We interpret this sum as 
if X n = 0. So 

G n+1 (s) = E [s x ^] = E [s^fil c,] = Gn (G(s)). 
Hence, by induction, for n > 1, 

G n (s) = G(G(...G(s)...)). 
s * ' 

n times 

Now, E [X n ] = G' n {\). By the chain rule, 

G' n (s) = ±G(G n ^(s)) = G'^WiG^is)). 

Plugging in s = 1, we get 

E [X n ] = E [Vi] = E [X n _r] » = ■ ■ ■ = M n . 
In particular, notice that we get exponential growth on average. □ 
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Chapter 6 



Random samples and the weak law 
of large numbers 



Definition 6.1. Let Xi,X 2 , ■ ■ ■ ,X n denote i.i.d. random variables. Then these random variables are 
said to constitute a random sample of size n from the distribution. 

Statistics often involves random samples where the underlying distribution (the "parent distribution") is 
unknown. A realisation of such a random sample is used to make inferences about the parent distribution. 
Suppose, for example, we want to know about the mean of the parent distribution. An important 
estimator is the sample mean. 

1 " 

Definition 6.2. The sample mean is defined to be X n = — > Xj. 

n ^— ' 

i=i 

This is a key random variable which itself has an expectation and a variance. Recall that for discrete 
random variables X and Y , 

var (X + Y) = var (X) + var (Y) + 2cov (X, Y) . 
We can extend this (by induction) to n random variables as follows: 

(n \ n 

Y Xi = ]T var (Xi) + ]T cov (X h Xj) . 
i—1 / i—1 i^j 

Theorem 6.3. Suppose that X\, X 2 , ■ ■ ■ , X n form a random sample from a distribution with mean fi 
and variance a 2 . Then the expectation and variance of the sample mean are 

E \X n ] = u and var (X n ) = — a 2 . 

' n 

Proof. We have E [Xj] = \i and var (X,) = a 2 for 1 < i < n. So 



E [X n ] = E 
var (X„) = var 



n i n 

n — ' 7i — ^ 





i=i 




i 
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since independence implies that cov (X i} Xj) = for all i ^ j. 



□ 



Example 6.4. Let X\, . . . ,X n be a random sample from a Bernoulli distribution with parameter p. 
Then E [Xi] — p, var (Xi) — p(l — p) for all 1 < i < n. Hence, E [X n ] = p and var (X n ) = p(l — p)/n. 

In order for X n to be a good estimator of the mean, we would like to know that for large sample sizes 
n, X n is not too far away from p i.e. that \X n — n\ is small. The result which tells us that this is true 
is called the law of large numbers and is of fundamental importance in probability. Before we state it, 
let's step away from the sample mean and consider a more basic situation. 

Suppose that A is an event with probability P (A) and write p — P (A) . Let X be the indicator function 
of the event A i.e. the random variable defined by 



X(u) = 1 a (oj) 



1 if lu e A 
if w ^ A. 



Then X ~ Ber(p) and E [X] = p. Suppose now that we perform our experiment repeatedly and let Xi 
be the indicator of the event that A occurs on the ith trial. Our intuitive notion of probability leads us 
to believe that if the number n of trials is large then the proportion of the time that A occurs should be 
close to p i.e. 



1 



i=l 



Xi 



p 



should be small. So proving that the sample mean is close to the true mean in this situation will also 
provide some justification for the way we have set up our mathematical theory of probability. 

Theorem 6.5 (Weak law of large numbers). Suppose that X\, X 2l ■ ■ ■ are independent and identically 
distributed random variables with mean p, and variance a 2 < oo. Then for any fixed e > 0, 



1 ™ 



[1 



> e -> 



as n — > oo . 



(Equivalently, we could have put 



fit* 



< € -> 1 



as n — > oo. 



In other words, the probability that the sample mean deviates from the true mean by more than some 
small quantity e tends to as n — > oo. Notice that the result only depends on the underlying distribution 
through its mean. There is also a more general version which does not require the fmiteness of the 
variance, but we won't discuss it here. 



In order to prove the weak law, we need a very useful inequality. 

Theorem 6.6 (Chebyshev's inequality). Suppose that Y is a random variable such that E [F 2 ] exists. 
Then for any t > 0, 

E[Y 2 ] 



\Y\ >t)< 



t 2 
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Proof. Let A = {\Y\ > t}. We may assume that P (A) > 0, since otherwise the result is trivially true. 
Then by the law of total probability for expectations, 

E[Y 2 ] =E[Y 2 \A]¥(A)+E[Y 2 \A C ]¥{A C ) >E[Y 2 \A]¥ (A) , 

since P {A c ) > and E [Y 2 \A C ] > 0. Now, we certainly have E [Y 2 \A] = E [Y 2 \\Y\ > t] > t 2 . So, 
rearranging, we get 

E [Y 2 ] 



as we wanted. 



I*1>*)< 



i 2 



□ 



Proof of Theorem 6.5. Set 

Then 

E [Y 2 ] = E 
So by Chebyshev's inequality, 



1 ™ 



i=i 



var 



>e < 



if* - 



C7 

n 



Since e > is fixed, the right-hand side tends to as n — > oo. 



□ 
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Chapter 7 

Continuous random variables 



7.1 Random variables and cumulative distribution functions 

Recall that we defined a discrete random variable on a probability space (fi, J",P) to be a function 
X : Q — > R such that X can only take countably many values (and such that we can assign a probability 
to the event {X = x}, i.e. such that {X = x} e J). There is, however, a more general notion. The 
essential idea is that a random variable can be any (sufficiently nice) function X : O — > R, which 
represents some sort of observable quantity in our random experiment. 

Why do we need more general random variables? 

• Some outcomes are essentially continuous. In particular, many physical quantities are most nat- 
urally modelled as taking uncountably many possible values, for example, lengths, weights and 
speeds. 

• Even for discrete quantities, it is often useful to think instead in terms of continuous approximations. 
For example, suppose you wish to calculate the number of working adults who regularly contribute 
to charity. You might model this number as X out of n, where n is the total number of working 
adults in the UK. We could, in theory, model this as a Bin(n,p) random variable where p = 
P (adult contributes). But n is measured in millions. So instead model Y w ^ as a continuous 
random variable taking values in [0, 1] and giving the proportion of adults who contribute. 

To give a concrete example of a random variable which is not discrete, imagine you have a board game 
spinner. You spin the arrow and it lands pointing at an angle somewhere between and 2tt in such a 
way that every angle is equally likely; we want to model this angle as a random variable X. How can we 
describe its distribution? We can't assign a positive probability to each angle - our probabilities wouldn't 
sum to 1. To get around this, we don't define the probability of individual sample points, but only of 
certain natural events. For example, by symmetry we expect that P (X < n) = 1/2. More generally, we 
expect the probability that X lies in an interval [a, b] C [0, 2w) to be proportional to the length of that 
interval: P (X e [a, &]) = < a < b < 2ir. 

Definition 7.1. A random variable X defined on a probability space (f2, J 7 , P) is a function X : Q — > R 
such that {uj : X(oj) < x} e T for each 
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Let's just check that this includes our earlier definition. If X is a discrete random variable then 

{lo : X(lu) <x}= |J {uj : X(oj) = y}. 

y<x:y£lmX 

Since ImX is countable, this is a countable union of events in F and, therefore, itself belongs to F . 

Of course, {u : X(u) < x} e F means precisely that we can assign a probability to this event. The 
collection of these probabilities as x varies in R will play a central part in what follows. 

Definition 7.2. The cumulative distribution function (c.d.f.) of a random variable X is the function 
F x : K -> [0, 1] defined by 

F x (x) = ¥(X < x). 

Example 7.3. Let X be the number of heads obtained in three tosses of a fair coin. Then ¥ (X = 0) = |, 
¥(X = l)=V(X = 2) = | and¥(X = 3) = |. So 



Fx{x) = { 



+ 3 = 1 
'8 2 

3 i 3 _ 7 
« ~r « s 



if x < 
«/ < a; < 1 
if 1 < a; < 2 
i/ 2 < a; < 3 
if x >3. 







Example 7.4. Lef X &e the angle of the board game spinner. Then 

'0 ifx<0, 
Fx(x)=\^ if0<x<2n, 
1 ifx>2n. 



We can immediately write down some properties of the c.d.f. F x corresponding to a general random 
variable X. 

Theorem 7.5. 1. Fx is non- decreasing. 

2. P (a < X < b) = F x (b) - F x (a) for a<b. 

3. As x ->• -co, F x (x) -> 0. 
^. j4s x -> oo 7 Fx(x) -> 1. 



Proof. 1. If a < 6 then {w : < a} C : < b} and so 

F x (a) = ¥(X < a) < ¥ (X < b) = F x (b). 

2. Since {X < a} is a subset of {X < b}, 

¥ (a < X < b) = ¥ {{X < b} \ {X < a}) = ¥ {X < b) - ¥ (X < a) = F x {b) - F x (a). 

3 & 4. (sketch) Intuitively, we want to put "Fx(— oo) = P (X < — oo)" and then, since X can't possibly 
be — oo (or less!), the only sensible interpretation we could give the right-hand side would be 0. Likewise, 
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we would like to put ll Fx{oo) = P (X < oo)" and, since X cannot be larger than oo, the only sensible 
interpretation we could give the right-hand side would be 1. The problem is that oo and — oo aren't real 
numbers, but Fx is a function on R. The only sensible way to deal with this problem is by taking limits 
instead. 1 □ 

Conversely, any function F satisfying conditions 1, 3 and 4 of Theorem 7.5 plus right- continuity is the 
cumulative distribution function of some random variable defined on some probability space, although 
we will not prove this fact. 

As you can see from the coin-tossing example, Fx need not be a smooth function. Indeed, for a discrete 
random variable, Fx is always a step function. However, in the rest of the course, we're going to 
concentrate on the case where Fx has a derivative (i.e. Fx is very smooth). 

Definition 7.6. A continuous random variable X is a random variable whose c.d.f. satisfies 

F x (x) =¥(X <x) = f fx(u)du, 

J — oo 

where fx ■ K — > K is a function such that 

(a) f x (u) > for allueR 

(b) J^fx(u)du=l. 

By the Fundamental Theorem of Calculus, we then have that Fx(x) is diffcrentiable with 

^ -*<•>■ 

fx is called the probability density function (p.d.f.) of X or, sometimes, just its density. 
Example 7.7. Suppose that a continuous random variable X has p.d.f. 



cx 2 (l-x) forxe [0,1] 
otherwise. 



fx(x) 

Find the constant c and an expression for the c.d.f. 

1 The following rigorous proof of 3 and 4 is here just for interest, and is non-cxaminablc. You are welcome to ignore it! 
Recall the alternative version of axiom P4: 

P4: If Ai D Ai D . . . is a sequence from T with n„A n = 0, then (P(A„)) n > 1 is a decreasing sequence which tends to 
as n — > 00. 

3. First notice that since Fx(x) decreases as x decreases, it's sufficient to show that Fx(—n) — > as n — > 00 through the 
integers. Take A n = {w : X(ui) < —n} so that ¥(A n ) = Fx(—n). Then, A n 3 A n +\ for all n> I. Since no real number 
is smaller than all of the negative integers, we have 

n A i = 0- 

i>i 

Hence by P^, Fx(— ri) — > as n — > 00. 

4. Again, since Fx(x) increases as x increases, it's sufficient to show that Fx(n) — > 1 as n — > 00. By taking complements 
in P^, we get that if B\ C B2 C . . . are events with U;>i-B; = f2 then 

¥(B n ) f 

as n — > co. Take B n = {lu : X(u>) < n} so that P (B n ) = Fx(n) and B n C -B n +i for all n > 1. Moreover, since every real 
number is smaller than some positive integer, 

U Bi = n. 

i>i 

The result follows. 
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Solution. To find the constant, c, note that we must have 



/oo /> 1 

fx{x)dx = / cx 2 (l — x)dx 
x Jo 



X X 

T ~ T 



c 

12' 



It follows that c = 12. To find the c.d.f., we simply integrate: 





F x (x) - f fx{x)dx= < 



for x < 
/* 12x 2 (1 -x)dx for < x < 1 
1 for x > 1. 



Since 



we get 



y 12x 2 (l -x)dx = 12 [ — 



for x < 
F x {x) = { 4x 3 - 3x 4 forO<x<l 

1 for x > 1. 



□ 



Example 7.8. TTie duration in minutes of mobile phone calls made by students is modelled by a random 
variable, X, with p.d.f. 

'\e~ x ' 6 ifx>0 



fx(x) 







otherwise. 



What is the probability that a call lasts 

(i) between 3 and 6 minutes? 
(ii) more than 6 minutes? 



Solution. (i) 



(ii) 



e ~ x/6 dx ■■ -- < 



'(3<X<6) = J^ fx(x)dx-- 

P(X>6) = f x (x)dx= -e~ x/(i dx = e- 1 . 
Je J6 6 



□ 



We often use the p.d.f. of a continuous random variable analogously to the way we used the p.m.f. of a 
discrete random variable. There are several similarities between the two: 



Probability density function (continuous) 


Probability mass function (discrete) 


fx(x)>0 Viet 


p x (x)^0 Viet 


/ fx(x) = 1 




J — OO 




F x {x)= f f x {u)du 


F x{x) = Px( u ^ 


J -co 
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However, the analogy can be misleading. For example, there's nothing to prevent fx{x) exceeding 1. 



WARNING: f x (x) IS NOT A PROBABILITY. 



Suppose that e > is small. Then, by Taylor's theorem, 

P {x < X < x + e) = F x (x + e) - F x (x) « f x (x)e. 

So f x (x)e is approximately the probability that X falls between x and x + e (or, indeed, between x — e 
and x). What happens as e — > 0? 

Theorem 7.9. If X is a continuous random variable with p.d.f. f x then 

P (X = x) = for all x & R 

and 

P(a < X < b) = ( f x (x)dx. 

J a 



Proof. (Non-examinable.) We argue by contradiction. Suppose that for some xeMwe have P (X = x) > 
0. Let p = P (X = x). Then for all n > 1, P (x - l/n < X < x) > p. We have P (x - l/n < X < x) = 
F x (x) — F x (x — l/n) and so F x (x) — F x (x — l/n) > p for all n > 1. But F x is continuous at x and so 

lim (F x (x) -F x (x- l/n)) = 0. 

n— >oo 

This gives a contradiction. So we must have P (X = x) = 0. 

Finally, P (a < X < b) = P (X = a) + P (a < X < b) and so, since P (X = a) = 0, we get 

F(a < X < b) = [ f x (x)dx. □ 



So for a continuous r.v. X, the probability of getting any fixed value x is 0! Why doesn't this break our 
theory of probability? We have 

{lo : X(lu) < x} - |J {lu : X(u>) = y} 

y<x 

and the right-hand side is an uncountable union of disjoint events of probability 0. If the union were 
countable, this would entail that the left-hand side had probability also, which wouldn't make much 
sense. But because the union is uncountable, we cannot expect to "sum up" these zeros in order to get 
the probability of the left-hand side. The right way to resolve this problem is using a probability density 
function. 

Remark 7.10. There do exist random variables which are neither discrete nor continuous. To give a 
slightly artificial example, if X is a discrete random variable and Y is a continuous random variable 
then X + Y is a random variable which can take uncountably many values but does not have a density. 
The theory is particularly nice in the discrete and continuous cases because we can work with probability 
mass functions and probability density functions respectively. But the cumulative distribution function is 
a more general concept which makes sense for all random variables. 
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7.2 Some classical distributions 



As we did for discrete distributions, we introduce a stock of examples of continuous distributions which 
will come up time and again in this course. 

1. The uniform distribution. X has the uniform distribution on an interval [a,b] if it has p.d.f. 



„ , . [ 5-^— for a < x < b, 
f x (x) = { b - a ~ ~ ' 

otherwise. 



We write X ~ U[o,6]. 



2. The exponential distribution. X has the exponential distribution with parameter A > if it 
has p.d.f. 

fx(x) = Xe- Xx , x>0. 

We write X ~ Exp(A). The exponential distribution is often used to model lifetimes or the time 
elapsing between unpredictable events (such as telephone calls, arrivals of buses, earthquakes, 
emissions of radioactive particles, etc). 

3. The gamma distribution. X has the gamma distribution with parameters a > and A > if 
it has p.d.f. 

fx(x) = ^x a - 1 e- Xx , x>0. 
Here, T(a) is the so-called gamma function, which is defined by 



/•OO 

(«)= / 

Jo 



T(a) = / u a - l e~ w du 



for a > 0. For most values of a this integral does not have a closed form. However, for a strictly 
positive integer n, we have = (n — 1)!. (See the Wikipedia "Gamma function" page for lots 
more information about this fascinating function!) 

If X has the above p.d.f. we write X ~ Gamma(a, A). The gamma distribution is a generalisation of 
the exponential distribution and possesses many nice properties. The Chi-squared distribution with 
d degrees of freedom, y? d , which you may have seen at 'A' Level, is the same as Gamma(d/2, 1/2) 
for d e N. 

4. The normal (or Gaussian) distribution. X has the normal distribution with parameters \i > 
and a 2 > if it has p.d.f. 

M.x) = -=L=expf-^-#V xeR. 



We write X ~ N(yU, a 2 ). The standard normal distribution is N(0, 1). The normal distribution 
is used to model all sorts of characteristics of large populations and samples. Its fundamental 
importance across Probability and Statistics is a consequence of the Central Limit Theorem, which 
you will use in Prelims Statistics and see proved in Part A Probability. 

Exercise 7.11. For the uniform and exponential distributions: 

• Check that for each of these fx really is a p.d.f. (i.e. that it is non-negative and integrates to 1). 

• Calculate the corresponding c.d.f.'s. 
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Example 7.12. Show that 

J-„ VSi' \ 2a 2 I 
Solution. We first change variables in the integral. Set z — (x — fi)/cr. Then 

^Lvh cxp (- {J ^f) dx = L vfc exp K) dz - 

It follows that 

Now convert to polar co-ordinates: let r and 9 be such that x — rcosO and y — rsinO. Then the 
Jacobian is | J| = r and so we get 

Since / is clearly non-negative (it's the integral of a non-negative function), we must have 1=1. □ 

The c.d.f. of the standard normal distribution, 

F x (x) = f -L e -« 2 /2 dM; 

J-oo V27T 

cannot be written in a closed form, but can be found by numerical integration to an arbitrary degree of 
accuracy. This very important function is usually called <& and if you did some Statistics at 'A' Level 
you will certainly have come across tables of its values. 



7.3 Expectation 

Recall that for a discrete r.v. we defined 

E[X]= x Px{x) 

xeln\X 

whenever the sum is absolutely convergent and, more generally, for any function h : R — > R, we had 

E[h(X)}= h(x)vx(x) 

xelmX 

whenever this sum is absolutely convergent. We want to make an analogous definition for continuous 
random variables. Suppose X has p.d.f. fx- Then for any x and small 6 > 0, 

F(x<X<x + 5)n f x (x)6 

and, in particular, 

P (nS < X < (n + 1)5) w f x (nS)5. 



-r 2 /2 



= 1. 
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So for the expectation, we want something like 

CO 

]T (nS)f x (nS)S. 

n=—oo 

We now want to take S — > 0; intuitively, we should obtain an integral. 

Definition 7.13. Let X be a continuous random variable with probability density function fx- The 
expectation or mean of X is defined to be 

/oo 
xf x (x)dx 
-oo 

whenever \x\fx(x)dx < oo. Otherwise, we say that the mean is undefined. 

More generally, if h : R — >• R is any function such that \h(x)\fx(x)dx < oo then we define the 
expectation of h(X) to be 

/oo 
h(x)f x (x)dx. 
-OO 



El 



As before, we define the variance of X to be 

var(X) =E [{X-E[X}) 2 ] . 
For simplicity of notation, write fi = E [X]. Then we have 

/oo 
(a; - fi) 2 f x (x)dx 
-OO 

(x 2 — 2xfi + fi 2 )fx(x)dx 

/OO pOO /'CO 

x 2 fx(x)dx-2n xf x (x)dx + Li 2 fx{x)dx 
-oo J —oo J —oo 

= E[X 2 ]-^, 

since xfx(x)dx = \x and fx(x)dx = 1. So we recover the expression 

var(X) =E [X 2 ] - (E[X]) 2 . 

Just as in the discrete case, expectation has a linearity property. 

Theorem 7.14. Suppose X is a continuous random variable with p.d.f. fx- Then if a,b G R t/ien 
E [a! + b] = aE [X] + b and var (aX + b)= a 2 var (X) . 

Proof. We have 

/>oo />oo />oo 

(ai + b)f x (x)dx = a xf x (x)dx + b f x (x)dx = aE [X] + 6, 
-oo J —oo J —oo 

as required, since the density integrates to 1. Moreover, 
var (aX + b) = E [(aX + b - aE [X] - b) 2 ] = E [a 2 (X - E [X]) 2 ] = a 2 E [{X - E [X]) 2 ] = a 2 var (X) . 

□ 
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Example 7.15. Suppose X ~ N(/z, a 2 ). Then 

• X has the same distribution as n + crZ, where Z ~ N(0, 1). 

• X /ias c.d./. Fx(x) = <j>((x — n)/a), where $ is ifte standard normal c.d.f. 

• E[X}= /i. 

• varpsT) =ct 2 . 

Solution. First suppose that \i — and er 2 = 1. Then the first two assertions are trivial and 

/oo 



which must equal since the integrand is an odd function. Since the mean is 0, 

/qq 2 poo j 2 

-^e'^^dx = x- Xe dx. 
-oo v 27T J — oo 



/2?r 

Integrating by parts, we get that this equals 

-x 2 /2 



e 

—x ■ - 



/OO -| 
-oo V27T 



/2tt 

So var(X) = 1. 

Suppose now that Z ~ N(0, 1). Then 

P (fi + oZ < x) = P (Z < (x - fj,)/a) = ®((x - n)/o). 
Let 4>{x) — -^=e~ x2 / 2 , the standard normal density. Differentiating P [p, + crZ < x) in x, we get 

^ ((x ^ /i)/,T) = ^p cxp r^^ 

So /z + o-Z ~ N(/x, cr 2 ). Finally, 

E [X] = E [/i + oZ] = fi + oE [Z] = ii 

and 

var (X) = v&r{p + aZ) = er 2 var (Z) = cr 2 . □ 
Exercise 7.16. Show that if X ~ U[a, 6] and F ~ Exp(A) then 

E[X} = °^, var(X) = ^ T ^, E [Y] = I, var(Y) = l 

Notice, in particular, that the parameter of the Exponential distribution is the reciprocal o/ its mean. 
Example 7.17. Suppose that X ~ Gamma(2,2), so that it has p.d.f. 



fx(x) = 
FmdE[X] andE[±]. 
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Axe 2x for x > 0, 
otherwise. 



Solution. We have 

poo 23 

Z A = I .;■ • 4.r< - J (!.t = I —x z - x e- 2x dx 



x-4xe- 2x dx= / 

-oo J — ( 



and, since F(3) = 2! we recognise the integrand as the density of a Gamma(3, 2) random variable. So it 
must integrate to 1 and we get E [X] = 1. 



On the other hand, 

" 1 



E 



X 



- ■ Axe~ 2x dx = 2 / 2e- 2x dx 
-oo x J_ 



and again we recognise the integrand as the density of an Exp(2) random variable which must integrate 
to 1. So we get E [i] = 2. 

Note that, in general, E [j^] ^ jp^ • □ 



7.4 Functions of continuous random variables 



Example 7.18. Imagine a forest. Suppose that R is the distance from a tree to the nearest neighbouring 
tree. Suppose that R has p.d.f. 

re~ r I 2 for r > 0, 
otherwise. 



fii(r) = 

Find the distribution of the tree-free area around the original tree. 



Solution. Let A be the tree-free area; then A — irR 2 . We begin by finding the c.d.f. of R and then use 
it to find the c.d.f. of A. F R (r) is clearly for r < 0. For r > 0, 



= l- e - 2 /2. 

o 



F R (r) =¥{R<r)= f se- s2 ' 2 ds = 
Hence, using the fact that R can't take negative values, 

F A (a) - P (A < a) = P (irR 2 <a)^¥^R< = F R (J^j = 1 - e- 1 ' 1 - 2 ^ 

for a > 0. Of course, Fa (a) = for a < 0. Differentiating for a > 0, we get 

f A (a) = ^e-^\ 

So, recognising the p.d.f., we see that A is distributed exponentially with parameter l/(27r). □ 
We can generalise the idea in this example to prove the following theorem. 

Theorem 7.19. Suppose that X is a continuous random variable with density fx and that h : R — > M 
is a differ entiable function which is strictly increasing (i.e. dh ^ > for all x). Then Y = h(X) is a 
continuous random variable with p. d.f. 



f Y (y) = fx(h- 1 (y))±h-\y), 



where h 1 is the inverse function of h. 



59 



Proof. Since h is strictly increasing, h(X) < y if and only if X < h 1 (y). So the c.d.f. of Y is 

F Y (y) =¥(h(X) <y)=¥(X< fr^y)) = i^" 1 ^))- 
Differentiating with respect to y using the chain rule, we get 

fY(y) = fx(h-\y))~h- 1 (y). 

ay 



□ 



There is a similar result in the case where h is strictly decreasing. In any case, you may find it easier to 
remember the proof than the statement of the theorem! 

What if the function h is not one-to-one? It's best to treat these on a case- by-case basis and think them 
through carefully. Here's an example. 

Example 7.20. Suppose that a point is chosen uniformly from the perimeter of the unit circle. What 
is the distribution of its x- -co-ordinate? 

Solution. Represent the chosen point by its angle, 8. So then has a uniform distribution on [0, 2tt), 
with p.d.f. 

= «*0<0<2« 
I otherwise. 

Moreover, the x-co-ordinate is X = cosG, which takes values in [—1, 1]. We again work via c.d.f.'s: 

'0 for 6 < 

yr< -»" ? ) = I h for 0< 6» <2tt 
1 for 9 > 2tt. 

Notice that there are two angles in [0, 2ir) corresponding to each x-co-ordinate in (—1, 1): 




Then 



F x (x) = P(cose < x) 

= P (arccos x < 9 < 2ir — arccos x) 
= Fq(2it — arccos x) — Fq (arccos x) 



arccos x arccos x 



2ir 

1 arccos x. 

7T 



2tt 



GO 



Fix arccosx € [0, it). Differentiating, we get 

tor-l<x<l 



fx(x) = < for x < -1 or x > 1 

I undefined for x = — 1 or x = 1. 



Notice that /x(i)^ooasi^lon^-l even though f x (x)dx = 1. □ 



7.5 Joint distributions 

We will often want to think of different random variables defined on the same probability space. In the 
discrete case, we studied pairs of random variables via their joint probability mass function. For a pair of 
arbitrary random variables, we use instead the joint cumulative distribution function, Fxy ■ K 2 —> [0, 1], 
given by 

F x ,Y(x,y)=V(X <x,Y <y). 
It's again possible to show that this function is non-decreasing in each of its arguments, and that 



and 



lim lim Fx,y(x,u) = 

x^ — qo y— > — oo 



lim lim Fxy(x,y) = 1. 

x— >oo y— 7-oo 



Definition 7.21. Let X and Y be random variables such that 

/y rx 
/ fx,Y{u 1 v)dudv 
-OO J —CO 

for some function fx,Y : K 2 — > M such that 
( a ) fx.y{ u i v ) > for all !i,«eR 

W J^o i^L / (^7 = 1. 

Then X and Y are jointly continuous and fx,Y is their joint density function. 
Of course, 

d 2 

fx, Y (x,y) = ^-F x ,Y(x,y). 

For a single continuous random variable X, it turns out that the probability that it lies in some nice set 
4gR (see Part A Integration to see what we mean by "nice" , but note that any set you can think of or 
write down will be!) can be obtained by integrating its density over A: 



' (X e A) = f f x (x)da 

J A 



Likewise, for nice sets B C R 2 we obtain the probability that the pair (X, Y) lies in B by integrating 
the joint density over the set B: 



F((X,Y)eB)= { { f x ,Y(x,y)dxdy. 
J J(x,v)eB 



l(x,y)el 

We will show here that this works for rectangular regions B. 
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Theorem 7.22. For a pair of jointly continuous random variables X and Y , we have 



>(a<X <b,c<Y <d)= / f x ,y(x,y)dxdy, 

J c J a 



for a < b and c < d. 



Proof. We have 



P(o < X < b,c < Y < d) 

= P (X <b,Y <d)-¥(X <a,Y <d)+V(X < a,Y < c) - P (X < b,Y < c) 
= F x ,y(b, d) - F x ,y(a, d) + F x ,y(a, c) - F x ,y(b, c) 



d r b 



fx,v(x,y)dxdy. □ 
Definition 7.23. If X and Y have joint density fx,Y then the marginal densities of X and Y are 

/oo 
fx,v{x,y)dy 
-OO 

and 

pOO 

fr{y) = / f x . y {x,y)dx 



respectively. 

These definitions generalise straightforwardly to the case of n random variables, X\, X2, ■ ■ ■ , X n . 
Example 7.24. Let 

( ±{x + y) for0<x<l,l<y<2, 



fx,y{x,y) 







otherwise. 



Check that fx.y{ x , y) is a joint density. What is P [X < |, Y > |) ? What are the marginal densities? 
What is P (X > |) ? 



Solution. Clearly, fx,y(x,y) > for all i,j/£R. We have 

r 2 ,-\ 



00 />oo 



fx,y(x,y)dxdy 



OO ^ — OO 



1 JO 
2 



-{x + y)dxdy 



1 L 

2 



1 2 1 

4^ +2^ 



dy 



= 1. 
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We have 



~ 2' ~ 2 



2 /-1/2 



3/2 ^0 

2 r 



(a: + y)dxdy 



3/2 
2 



1 2 1 



1/2 





dy 



'3/2 
JL I 2 

16 y + 8 y 



3/2 



Integrating out y we get 



/l 13 
-{x + y)dy = -x + - 

for x G [0, 1], and integrating out x we get 

f 1 1 11 

fv{y) = -(x + y)dx = - + -y 

for ye [1,2]. Using the marginal density of X, 



X > 



3\ , 9 



□ 



Definition 7.25. Jointly continuous random variables X and Y with joint density fx y ar ^ independent 

»7 

fx,y(x,y) = fx(x)f Y (y) 

for all x,y G R. Likewise, jointly continuous random variables X\, X 2 , . ■ . , X n with joint density 
fx 1 ,x 2 ,...,x„ are independent if 

fx 1 ,X 2 ,...,X n (xi,X 2 , ...,X n ) = f Xl (xi)fx 2 {x 2 ) ■ ■ ■ fx n (x n ) 

for all x\,X2, ■ ■ ■ , x n e R. 



Note that if X and Y are independent then it follows easily that 

Fx,y{x,y) = F x (x)F Y (y) 

for all 1,1/eR. 

Example 7.26. Consider the set-up of Example 7.24- Since there exist x and y such that 



X and Y are not independent. 
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7.5.1 Expectation 



We define the expectation of a function ft, of a pair of jointly continuous random variables in the obvious 
way: 

/oo />oo 
/ h(x,y)f x , Y (x,y)dxdy. 
-oo J — oo 

In particular, the covariance of X and Y is 

cov (X, Y) = E [(X — E [X])(Y - E [Y])] = E [XY] - E [X] E [Y] 
(exercise: check the second equality). 
Exercise 7.27. CTiecfc i/iai 

E [X + Y] = E [X] + E [Y] 

and 

var (X + Y) = var (X) + var (Y) + 2cov (X, Y) . 

Remark 7.28. We have now shown that the rules for calculating expectations (and derived quantities 
such as variances and covariances) of continuous random variables are exactly the same as for discrete 
random variables. This isn't a coincidence! We can make a more general definition of expectation which 
covers both cases (and more besides) but in order to do so needs a proper theory of Integration, which 
you will see in Part A. For the moment, we just observe that the fact that everything works the same 
way for continuous random variables as it does for discrete ones has the consequence that the things we 
did in Chapter 6 applies for continuous random variables too. In particular, it makes perfect sense to 
think about a random sample from, a continuous distribution, and you will deal with these extensively in 
Prelims Statistics next term. 

Example 7.29. Let —1 < p < 1. The standard bivariate normal distribution has joint density 

fxAx ' y) = ^k=7 cxp (~2(i~v) ( ^ 2 - 2pxy + y2) ) 

for x, y € K. What are the marginal distributions of X and Y? Find the covariance of X and Y. 



Proof. We have 



/*(*) = cxp (- (* 2 - 2 P xy + dy 

= L WT=7 cxp (" 2(T 1 7) [iy ~ pxf + x2[l ~ p2)] ) dy 

- 1 --^/;^^ex P (-^w 



V2n 7-00^(1-^2) "V 2(1 -p?) 

But the integrand is now the density of a normal random variable with mean px and variance 1 — p 2 . So 
it integrates to 1 and we are left with 

f x (x) = ^=e^l\ 
V Ztt 



SoX~ N(0, 1) and, by symmetry, the same is true for Y. Notice that X and Y are only independent if 
p = 0. 
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Since X and Y both have mean 0, we only need to calculate E [XY]. We can use a similar trick: 

E [XY] = II L cxp (- wh) {x2 - 2pxy + y2) ) dydx 

J-ooV2^ J-oo v^F(i - p 2 ) P V 2(1 

The inner integral now gives us the mean of a N(px, 1 — p 2 ) random variable, which is px. So we get 

cov (X, Y) = r ^=e- x2 / 2 dx = pE [X 2 ] = p, 

J-oo V27T 

since E [X 2 ] =1. □ 

This yields the interesting conclusion that standard bivariate normal random variables X and Y are 
independent if and only if their covariance is 0. This is a nice property of normal random variables which 
is not true for general random variables, as we have already observed in the discrete case. 
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